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£3 Pursuant to 37 CFR 1 .63(d)(1), a newly executed oath or declaration is not required. 

□ A newly executed oath or declaration is filed herewith 

□ I hereby state that the amendment referred to in the declaration filed to complete the 
prior application, in accordance with the requirements of 37 CFR § 1.53(b), did not 
introduce new matter therein. 

II. AMENDMENTS 

Cancel in this application original Claims 1-49 and 56-67 of the prior application 
before calculating the filing fee. (At least one original independent claim must be 
retained for filing purposes.) 

□ A Preliminary Amendment is enclosed. (Claims added by Amendment must be 
numbered consecutively beginning with the number next following the highest 
numbered original claim in the prior application.) 

III. INFORMATION DISCLOSURE STATEMENT 

^1 An Information Disclosure Statement and PTO 1449 are submitted herewith. 

IV. PETITION FOR SUSPENSION OF PROSECUTION FOR THE TIME TO FILE AN 
AMENDMENT 

□ There is provided herewith a PETITION FOR SUSPENSION OF PROSECUTION 
FOR THE TIME NECESSARY TO FILE AN AMENDMENT (NEW 
APPLICATION FILED CONCURRENTLY). 

V. FEE CALCULATION 



BASIC FILING FEE: 




$760.00 


Total Claims 6 20 = 0 


x $18.00 


$0.00 


Independent Claims 2 - 3=0 


x $78.00 


$0.00 


Multiple Dependent Claims $260 (if applicable) 


□ 


$0.00 


Surcharge 37 CFR § 1 .16(e) $130 (if applicable) 


□ 


$0.00 


TOTAL OF ABOVE CALCULATIONS 




$760.00 


Reduction by l A for Filing by Small Entity. Note 37 CFR §§ 1 .9, 1.27, 
1 .28. If atmlicable. Verified Statement must be attached. Kl 


$380.00 


Misc. Filing Fees (Recordation of Assignment) 




$0.00 


TOTAL FEES SUBMITTED HEREWITH 




$380.00 



□ The fee for extra claims is not being paid at this time. 
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VI. SMALL ENTITY STATUS 

A Verified Statement to establish small entity under 37 CFR §§ 1.9 and 1.27: 
[~1 is attached 

[>3 has been filed in the prior application and such status is still proper and desired. [37 
CFR § 1.28(a)] 

Filing Fee Calculation (50% of above) $380.00 

VII. DRAWINGS 

[NOTE: DO NOT CHECK THIS IF PRIOR CASE IS NOT TO BE ABANDONED.] 

□ Transfer the drawings from the prior application to this application and, subject to 
Item 16 below, abandon said prior application as of the filing date accorded to this 
application. A duplicate copy of this request is enclosed for filing in the prior 
application file. 

[May only be used if signed by (1) applicant, (2) assignee of record or (3) attorney or 
agent of record and before payment of issue fee. 37 CFR § 1 .138.] 

□ Transfer the following sheet(s) of drawings from the prior application to this 
application. 

□ New drawings are enclosed □ formal □ informal 

VIII. PRIORITY - 35 USC § 119 

□ Priority of application Serial No. filed on in Country is claimed under 

35 USC § 119. 

□ The certified copy has been filed in prior U.S. application Serial No. on . 

□ The certified copy will follow. 

IX. RELATE BACK - 35 USC § 120 

[>3 Amend the Specification by inserting before the first line the sentence: 

--This is a divisional of co-pending application Serial No. 08/801.471 filed February 
18. 1997 - 

X. INVENTORSHIP STATEMENT 

□ With respect to the prior co-pending U.S. application from which this application 
claims benefit under 35 USC § 120, the inventor(s) in this application is (are): 
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the same 

□ less than those named in the prior application and it is requested that the 
following inventor(s) identified above for the prior application be deleted: 

[Namefs^ of inventorfs^ to be deleted! 

[>3 The inventorship for all the claims in this application are: 
the same 

□ not the same, and an explanation, including the ownership of the various 
claims at the time the last claimed invention was made, is submitted. 

XI. ASSIGNMENT 

^1 The prior application is assigned of record to Vixel Corporation. 

□ An Assignment of the invention to is attached. 

XII. FEE PAYMENT BEING MADE AT THIS TIME 

□ Not attached. No filing fee is submitted. [This and the surcharge required by 37 CFR 
§ 1.16(e) can be paid subsequently.] 

[g] Attached. 

S Filing fees. $380.00 

□ Recording assignment. [$40.00 37 CFR § 1.21(h)(1)] _ 
Petition fee for filing by other than all the inventors or 

person on behalf of the inventor where inventor 
refused to sign or cannot be reached. 
[$130.00; 37 CFR §§1.47 and 1.17(h)] 

□ Petition fee to Suspend Prosecution for the Time _ 
Necessary to File an Amendment (New Application 

Filed Concurrently.) 
[$130.00; 37 CFR §§ 1.103 and 1.17(f)] 
[~~| For processing an application with a specification in a _ 
non-English language. 
[$130.00; 37 CFR §§ 1.52(d) and 1.17(k)] 
Processing and retention fee. _ 
[$130.00; 37 CFR §§ 1.53(f) and 1.21(1)] 

Total Fees Enclosed $380.00 
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XIII. METHOD OF PAYMENT OF FEES 

Attached is a check in the amount of $380.00 . 

□ Charge Deposit Account No. 12-2475 in the amount of . 

XIV. AUTHORIZATION TO CHARGE ADDITIONAL FEES 

The Commissioner is hereby authorized to charge the following additional fees by this paper 
and during the entire pendency of this application to Deposit Account No. 12-2475: 

IS] 37 CFR §1.1 6(a) (filing fees) 

3 37 CFR §1.1 6(b) (presentation of extra claims) 

^ 37 CFR §1.1 6(e) (surcharge for filing the basic filing fee and/or declaration on a date 
later than the filing date of the application) 

37 CFR §1.17 (application processing fees) 

Q 37 CFR §1.18 (issue fee at or before mailing of Notice of Allowance, pursuant to 37 
CFR§ 1.311(b)) 

XV. INSTRUCTIONS AS TO OVERPAYMENT 

ISI Credit Deposit Account No. 12-2475. 

□ Refund 

XVI. POWER OF ATTORNEY 

f~| The power of attorney in the prior application is to . 

□ The power of attorney in the prior application is to the registered attorneys listed 
below and members of or associates in the law firm of LYON & LYON LLP, 633 
West Fifth Street, 47 th Floor, Los Angeles, California 90071, Registration No. 1 1,611, 
whose members are registered to practice in the U.S. Patent and Trademark office: 
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Roland N. Smoot, Reg. No. 18,718 
Conrad R. Solum, Jr., Reg. No. 20,467 
James W. Geriak, Reg. No. 20,233 
Robert M. Taylor, Jr., Reg. No. 19,848 
Samuel B. Stone, Reg. No. 19,297 
Douglas E. Olson, Reg. No. 22,798 
Robert E. Lyon, Reg. No. 24,171 
Robert C. Weiss, Reg. No. 24,939 
Richard E. Lyon, Jr., Reg. No. 26,300 
John D. McConaghy, Reg. No. 26,733 
William C. Steffrn, Reg. No. 26,811 
Coe A. Bloomberg, Reg. No. 26,605 
J. Donald McCarthy, Reg. No. 25,1 19 
John M. Benassi, Reg. No. 27,483 
James J. Shalek, Reg. No. 29,749 
Allan W. Jansen, Reg. No. 29,035 
Robert W. Dickerson, Reg. No. 29,914 
Roy L. Anderson, Reg. No. 30,240 
David B. Murphy, Reg. No. 31,125 



James C. Brooks, Reg. No. 29,898 
Jeffrey M. Olson, Reg. No. 30,790 
Steven D. Hernrninger, Reg. No. 30,755 
Jerrold B. Reilly, Reg. No. 32,293 
Paul H. Meier, Reg. No. 32,274 
John A. Rafter, Jr., Reg. No. 3 1,653 
Kenneth H. Ohriner, Reg. No. 3 1, 646 
Mary S. Consalvi, Reg. No. 32,212 
Lois M. Kwasigroch, Reg. No. 35,579 
Lawrence R. LaPorte, Reg. No. 38,948 
Robert C. Laurenson, Reg. No. 34,206 
Carol A. Schneider, Reg. No. 34,923 
Hope E. Melville, Reg. No. 34,874 
Michael J. Wise, Reg. No. 34,047 
Richard J. Warburg, Reg. No. 32,327 
Kurt T. Mulville, Reg. No. 37,194 
Theodore S. Maceiko, Reg. No. 35,593 
Bruce G. Chapman, Reg. No. 33,846 
F. T. Alexandra Mahaney, Reg. No. 37,668 
Reg. No. 



£2 The power appears in the original papers in the prior application. 

C] The power does not appear in the original papers, but was filed on _ 
application. 

A new power has been executed and is attached. 
EX] Address all future communications to: 



_ in this 



LYON & LYON LLP 

633 West Fifth Street, 47 th Floor 

Los Angeles, California 90071 

(213) 489-1600 

Attention: David B. Murphv 

XVII. MAINTENANCE OF CO-PENDENCY OF PRIOR APPLICATION 

□ A petition, fee and response has been filed to extend the term in the pending prior 

application until . A copy of the petition for extension of time in the prior 

application is attached. 
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XVIII. CONDITIONAL PETITIONS FOR EXTENSION OF TIME IN PRIOR 
APPLICATION 

| [ A conditional petition for extension of time is being filed in the pending prior 
application. A copy of the conditional petition for extension of time in the prior 
application is attached. 

XIX. ABANDONMENT OF PRIOR APPLICATION 

□ Please abandon the prior application at a time while the prior application is pending 
or when the petition for extension of time or to revive in that application is granted 
and when this application is granted a filing date so as to make this application co- 
pending with said prior application. At the same time, please add the words "now 
abandoned" to the amendment of the specification set forth in Item 2 above. 



DBM/dnd 
633 West Fifth Street, Suite 4700 
Los Angeles, California 90071-2066 
(714) 751-6606 or (213) 489-1600 

Enclosures 

Vixel Corporation 
Name of Assignee 

15245 Alton Parkway. Suite 100. Irvine. CA 92618-2307 
Address of Assignee 

Chief Technology Officer - Stuart Berman 

Title of person authorized to sign on behalf of assignee 

Assignment recorded in PTO on 07/31/98 . Reel 9355. Frame 0314 



Respectfully submitted, 



LYON & LYON llp 



Dated: June 11. 1999 
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1 

DESCRIPTION 



FIBRE CHANNEL SWITCHING FABRIC 

5 Field of the Invention 

The present invention relates to input/output channel and networking systems, 
and more particularly to a digital switch which switches Fibre Channel frames at link 
speeds of up to at least one gigabit per second (i.e., one billion bits per second). 

10 Background of the Invention 

There is a never ending demand for increased computer system performance. 
A common limiting factor in computer system performance is the path from the main 
central processing unit (CPU) to storage, or the I/O path. The CPU usually requires 
data from attached storage many times faster than the I/O path. Fibre Channel is a 

1 5 standard which addresses this I/O bandwidth limitation. 

Fibre Channel is an American National Standards Institute (ANSI) set of 
standards which describes a nigh performance serial transmission protocol which 
supports higher level storage and networking protocols such as HIPPI, IPI, SCSI, IP, 
ATM, FDDI and others. Fibre Channel was created to merge the advantages of channel 

2 0 technology with network technology to create a new I/O interface which meets the 
requirements of both channel and network users. Channel technology is usually 
implemented by I/O systems in a closed, structured and predictable environment where 
network technology usually refers to an open, unstructured and unpredictable 
environment. 

2 5 Advantages of Fibre Channel include the following. First, it achieves high 

performance, which is a critical in opening the bandwidth limitations of current 
computer to storage and computer to computer interfaces at speeds up to 1 gigabit per 
second or faster. Second, utilizing fiber optic technology, Fibre Channel can overcome 
traditional I/O channel distance limitations and interconnect devices over distances of 

3 0 6 miles at gigabit speeds. Third, it is high level protocol independent, enabling Fibre 

Channel to transport a wide variety of protocols over the same media. Fourth, Fibre 
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Channel uses fiber optic technology which has very low noise properties. Finally, 
cabling is simple in that Fibre Channel typically replaces bulky copper cables with 
small lightweight fiber optic cables. 

Fibre Channel supports three different topologies, point-to-point, arbitrated loop 
5 and fabric attached. The point-to-point topology attaches two devices directly. The 
arbitrated loop topology attaches devices in a loop. The fabric attached topology 
attaches a device directly to a fabric. 

A Fibre Channel fabric is an entity which switches frames between connected 
devices. Fabric is a word which is synonymous with switch or router. The fabric must 
1 0 route the frame to the appropriate destination port or return a busy if the port is not 
available. 

Because of the high link speeds, Fibre Channel fabrics face unique problems 
that are not present in current network switch design. Current network switches which 
support Ethernet, Fast Ethernet or Asynchronous Transfer Mode (ATM) protocols route 

1 5 incoming data at speeds up to ten to one hundred times slower than Fibre Channel 
fabrics. Current network switches also perform some incoming frame validation and 
network statistics collection. All these network switch features are more difficult to 
implement when the incoming frame rate is high, as in the case of Fibre Channel. 

Route determination in network switches is usually performed by 

2 0 microprocessors. The requirement to route frames which are entering the fabric at 
speeds of up to one gigabit per second requires the fabric to route the frame in very little 
time. Routing depends not only on the incoming frame address but a host of other 
parameters and current state conditions as well. There are no currently available 
microprocessors which can in real time route sixteen lines of incoming frames with a 

2 5 link speed of 1 gigabit per second. 

Frame validation creates another set of problems. In Fibre Channel fabrics 
frame validation must be performed at rates up to one hundred times faster than in 
Ethernet switches. 

Statistics collection is also another function which must be performed in real 

3 0 time. Statistics collected are defined by the Fibre Channel fabric Management 

Information Base (MDB) and include the number of frames transmitted and received, the 
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number of fabric rejects and fabric busies transmitted and received, etc. Gathering 
statistics for sixteen one gigabit per second ports creates new challenges. 

Current fabric realizations use either fast microprocessors or digital signal 
processors to perform the route determination functions. Typically, processors are 
5 single instruction devices which serially decode the instructions and perform the 
specified function. Digital signal processors contain parallel functions and can perform 
several functions at one time. Still the problem exists to determine the route for many 
simultaneous incoming frames at one gigabit per second. Current fabric 
implementations perform routing on the order of tens of microseconds to hundreds of 
1 0 milliseconds. Ideally, routing should be accomplished in less than one microsecond. 

Another problem with fabric realization is the support of the Arbitrated Loop 
topology. This topology has unique characteristics and requirements. Current fabric 
implementations do not support this topology. 

Efficient support of both connection based classes of service (i.e., Class 1) and 
15 connectionless classes of service (i.e., Class 2 and 3) is also a challenge. A fabric must 
implement a different type of switch core to implement each class of service. 
Coordination between the different switch cores can be a burdensome task. Current 
fabric implementations support either a connection based or a connectionless switch 
core. This leads to inefficiencies, e.g., a connectionless switch core cannot switch Class 
2 0 1 traffic if routes are not detennined in frame time (i.e., less than one microsecond) and 
a connection switch core is very inefficient when routing Class 2 and Class 3 traffic. 

Another problem with fabric realization is the interconnection or networking of 
fabrics. This is a problem due to the high speeds involved. Determining a network 
route is sometimes even more difficult than deterrriining a local route. Destination 

2 5 addresses must be matched based not only on all bits matching but also matching a 

portion of the address. Route priorities should also be implemented to allow backup 
routes to a destination. 
Summary of the Invention 

The present invention described and disclosed herein comprises a method and 

3 0 apparatus for transporting Fibre Channel frames between attached devices. The 

apparatus comprises logic which supports but is not limited to the following features: 
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Transport of Class 1, Class 2 and Class 3 frames, Support for the Arbitrated Loop 
topology on each link, Support for Fabric point-to-point topology on each link, Route 
determination in frame arrival time, and Interconnection or Networking of Fabrics. 

In one aspect of the invention, the apparatus comprises separate port control 
5 modules, one for each attached device, a central router module, a switch core module, 
a fabric control module and a brouter (bridge/router) module. In the preferred 
embodiment, the port control modules are connected to the router modules by separate 
route request connections and separate route response connections. Through this 
structure, route requests may be provided from the port control module to the router 

10 while simultaneously the router provides route request responses to the same port 
control module. Preferably, a common route request channel is utilized. Thus, 
apparatus is provided to return a route response to a previously requesting port while 
other ports are arbitrating and sending route requests to the centralized router. More 
generally, this apparatus provides for reading resource requests from multiple requesters 

1 5 while at the same time returning resource grant responses to previous requesters. 

The router of the subject invention includes many advantageous aspects. In the 
preferred embodiment, the router includes multiple state machines arranged in series 
for pipeline operation. Specifically, in the preferred embodiment of the router, a 
hardware finite state machine operates on the route request and a hardware finite state 

2 0 machine provides the route response. Thus, in this embodiment, the router includes an 
input for receiving the output of the route request generator of the port control module, 
an output for sending a route request response to the route request response receiver in 
the port control module, a hardware finite state machine to receive the route request, 
and a hardware finite state machine to provide the route response, in combination with 

2 5 a route determination system. Through implementation in hardware, route responses 

may be made in less than two microseconds, which permits essentially real-time routing 
at gigahertz frequencies. 

In yet another aspect of the router, it routes Fibre Channel frames to a 
destination port on the Fabric based on a selected portion of the incoming frame's 

3 0 destination address. In the preferred embodiment, Fibre Channel FCPH protocol rules 

are applied to an incoming frame to determine whether to route the frame or return a 
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fabric reject or busy frames or to discard the frame. Validation of the routing of a Fibre 
Channel frame is based on the rules defined in the ANSI FCPH standards. In the 
preferred embodiment, route requests are serviced in a round robin manner from 
multiple ports. 

5 In another embodiment an apparatus and method is provided to store blocked 

route requests until either the blocking condition resolves itself or a specified time 
period expires. Thus, a method for servicing route request from multiple attached 
devices where the routing is subject to blocked and unblocked conditions may be 
effective, where the method comprises the steps of servicing a route request which is 

1 0 not blocked, but saving a blocked route request in hardware, preferably in registers, and 
then servicing that request if the route changes from a blocked to an unblocked 
condition, in the preferred embodiment, prior to the expiration of a specified time 
period. In a more general sense, the invention manages the blocking and unblocking 
of multiple resource requests to a central resource. 

15 In another embodiment an apparatus is provided to handle the scenario when a 

port input fifo is going to overflow with an incoming Fibre Channel frame. Generally, 
the incoming data stream is typically provided to an encoder/decoder, from which it is 
supplied to a buffer. In the event of a data overrun condition to the buffer, overrun 
prevention logic causes the setting of tag bits to a condition which may be recognized 

2 0 downstream as indicative of a buffer overflow condition. 

In another embodiment an apparatus is provided to interleave accesses by the 
processor on the outgoing port bus in between outgoing frames or when the output fifo 
is full. 

In another embodiment an apparatus is provided to pack requests in a register 

2 5 array in order of first arrival but allow the removal of the requests from anywhere in the 

array. 

Objects of the Invention 

It is an object of this invention to provide a fibre channel fabric capable of 
operating at at least 1 gigabit speeds. 

3 0 It is yet a further object of this invention to permit the establishment of a path 

through a fabric in real time at gigabit speeds. 
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It is yet a further object of this invention to provide 1 microsecond or less 
response time to fibre channel frames. 

It is another object of this invention to determine in real time at gigabit speeds 
that no through path can be established through the fabric. 
5 It is yet another object of this invention to provide a fibre channel fabric capable 

of simultaneously supporting Class 1, Class 2 and Class 3 service. 

It is an object of this invention to provide a fibre channel switching fabric which 
supports arbitrated loop topology. 

It is yet another object of this invention to provide systems and methods adapted 
1 0 for interconnection of multiple fabrics. 

It is yet another object of this invention to provide a system which supports 
Fabric point-to-point topology on each link. 

Brief Description of the Drawings 
15 FIG. 1 is a diagram illustrating the use of a Fibre Channel Fabric. 

FIG. 2 is a block diagram of a Fibre Channel Fabric. 

FIG. 3 is a block diagram of the Fabric Control module. 

FIG. 4 is a block diagram of the fabric Router. 

FIG. 5 is a block diagram of the fabric Port Control. 
2 0 FIG. 6 is a block diagram of the fabric Switch core 

FIG. 7 is a block diagram of the Brouter Module. 

FIG. 8 is a diagram of the Port Control FIFO Overrun Prevention Logic. 

FIG. 9 is a diagram of the Port Control Process to Endec Arbitration Logic. 

FIG. 10 is a more detailed description of the Port Control module. 

2 5 FIG. 1 1 is a diagram of the main Port Control FSM. 

FIG. 12 is a diagram of the Port Control PCFIFO module interface signals. 
FIG. 13 is a diagram of the Router address matching module. 
FIG. 14 is a diagram of the Router Route Request Unblock Determination 
module. 

3 0 FIG. 15 is a detailed diagram of the Route Request Unblock Determination 

module circuit. 
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FIG. 16 is another detailed diagram of the Route Request Unblock 
Determination module circuit. 

FIG. 17 is a diagram of the Blocked Route Request Table. 

FIG. 18 is a diagram of the Router Control State Machine. 
5 FIG. 1 9 is a diagram of the Blocked Route Request Port Register Array. 

FIG. 20 is a diagram of both the Route State Table and the Route Determination 
modules. 

FIG. 21 is a more detailed diagram of the Route Determination module. 
FIG. 22 is a another more detailed diagram of the Route Determination module. 

1 o FIG. 23 is a still another more detailed diagram of the Route Determination 

module. 

FIG. 24 is a diagram of the Port Control Route Request Interface module. 
FIG. 25 is a diagram of the Port Control Route Response Interface module. 
FIG. 26 is a diagram of the Router to Port Control Route Request State 
1 5 Machine. 

FIG. 27 is a diagram of the Router to Port Control Route Response State 
Machine. 

FIG. 28 is a diagram of the Port Control to Router Interface State Machine. 
FIG. 29.is a diagram of the Hub Port Control module. 

2 0 FIG. 30 is a diagram of the format of the Blocked Route Request Table entry. 

FIG. 31 is a diagram of the format of the Route Request. 

FIG. 32 is a diagram of the format of the Router to Port Control Response. 

FIG. 33 is a diagram of the format of the Address Table entry. 

FIG. 34 is a diagram of the format of the Route State Table entry. 

25 



Detailed Description of the Invention 
Table of Contents 
A. Definitions 
3 0 B. Fibre Channel Fabric Model 
C. Fabric Control Module 
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D. 


Fabric Router 




1. 


Port Control Route Request Interface Module 




2. 


Port Control Route Response Interface Module 




3. 


Address Table 


5 


4. 


Address Match Module 




5. 


Blocked Route Request Table 




6. 


Blocked Route Request Port Register Array 




7. 
8. 


Blocked Route Request Timer 

Route Request Unblock Determination Module 
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9. 


Route Request Selector 




10. 


Route Determination Module 




11. 


Route State Table 




12. 


Router Statistics Gathering Module 




13. 


Router Control FSM 


15 E. 


Port Control 




1. 


Port Control Module 




2. 


FIFO Overrun Prevention Logic 




3. 


Processor/Data Arbitration Logic 




4. 


Port Control Hub Module 



2 0 F. Switch Core 

G. Router Module 

H. Other Documents 



A. Definitions 

2 5 For expository convenience, the present invention is referred to as the Fibre 

Channel Fabric or Fabric, the lexicon being devoid of a succinct descriptive name for 
a system of the type hereinafter described. 

The "Fibre Channel ANSI standard" describes the physical interface, 
transmission protocol and signaling protocol of a high-performance serial link for 

3 0 support of the higher level protocols associated with HIPPI, IPI, SCSI, IP, ATM and 

others. 
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The "Fibre Channel Fabric" comprises hardware and software that switches 
Fibre Channel frames between attached devices at speeds up to one gigabit per second. 

The following discussions will be made clearer by a brief review of the relevant 
terminology as it is typically (but not exclusively) used. 

"Fibre Channel" is an American National Standard for Information Systems 
(ANSI) standard which defines a high performance serial link for support of the higher 
level protocols associated with HIPPI, IPI, SCSI, IP, ATM, FDDI and others. 

"FC-1" defines the Fibre Channel transmission protocol which includes the 
serial encoding, decoding, and error control. 

"FC-2" defines the signaling protocol which includes the frame structure and 
byte sequences. 

"FC-3" defines a set of services which are common across multiple ports of a 

node. 

"FC-4" is the highest level in the Fibre Channel standards set. It defines the 
mapping between the lower levels of the Fibre Channel and the IPI and SCSI command 
sets, the HEPPI data framing, IP, and other Upper Level Protocols (ULPs). 

"Fibre" is a general term used to cover all transmission media specified in the 
ANSI X3.230 "Fibre Channel Physical and Signaling Interface (FC-PH)" standard. 

A "fabric" is an entity which interconnects various N_Ports attached to it and 
is capable of routing frames by using only the D_ID information in the FC-2 frame 
header. The word Fabric can be seen as a synonym with the word switch or router. 

"Fabric topology" is a topology that uses the Destination Identifier (DID) 
embedded in the Frame Header to route the frame through a Fabric to the desired 
destination N_Port. 

"Point-to-point topology" allows communication between N_Ports without the 
use of a Fabric. 

A "circuit" is a bidirectional path that allows communication between two 
L_Ports. 

"Arbitrated Loop topology" permits three or more L_Ports to using arbitration 
to establish a point-to-point circuit. When two L_Ports are communicating, the 
arbitrated loop topology supports simultaneous, symmetrical bidirectional flow. 



10 

"Link Control Facility" is a facility which attaches to an end of a link and 
manages transmission and reception of data. It is contained within each Port type. 

"Port" is a generic reference to an NJPort or F_Port. 

An "NJPort" is a hardware entity which includes a Link Control Facility. 
5 An "NL_Port" is an N_Port that contains Arbitrated Loop functions associated with 
Arbitrated Loop topology. 

An "FPort" is a generic reference to an F_Port or FL_Port. 

An "FL Port" is an F Port that contains Arbitrated Loop functions associated 
with Arbitrated Loop topology. 
10 An "L_Port" is an N_Port or F_Port that contains Arbitrated Loop functions 

associated with Arbitrated Loop topology. 

A "Node" is a collection of one or more N_Ports controlled by a level above 

FC-2. 

A "dedicated connection" is a communicating circuit guaranteed and retained 
15 by the Fabric for two given N_Ports. 

A "connection" is the process of creating a Dedicated Connection between two 
N_Ports. 

A "disconnection" is the process of removing a Dedicated Connection between 
two N_Ports. 

2 0 A "frame" is an indivisible unit of information used by FC-2. 

"Frame content" is the information contained in a frame between its Start-of- 
Frame and End-of-Frame delimiters, excluding the delimiters. 

A "data frame" is a frame containing information meant for FC-4/ULP or the 
Link application. 

25 "Payload" is the contents of the Data Field of a frame, excluding Optional 

Headers and fill bytes, if present. 

"Source Identifier" or S_ID is the address identifier used to indicate the source 
Port of the transmitted frame. 

"Destination Identifier" or DJD is the address identifier used to indicate the 

3 0 targeted destination of the transmitted frame. 
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"Valid frame" is a frame received with a valid Start of Frame (SOF), a valid 
End of Frame (EOF), valid Data Characters, and proper Cyclic Redundancy Check 
(CRC) of the Frame Header and Data Field. 

"Classes of Service" are different types of services provided by the Fabric and 
5 used by the communicating N_Ports. 

"Class 1" service is a service which establishes a dedicated connection between 
communicating N_Ports. 

"Class 2" service is a service which multiplexes frames at frame boundaries to 
or from one or more N Ports with acknowledgement provided. 

1 o "Class 3" service is a service which multiplexes frames at frame boundaries to 

or from one or more N_Ports without acknowledgement. 

"Intermix" is a service which interleaves Class 2 and Class 3 frames on an 
established Class 1 connection. 

A "Gigabit Link Module" is a module which interfaces to the Endec through 
1 5 either a 10-bit or 20-bit interface and interfaces to the Fibre Channel link through either 
a copper or fiber interface. 

An "Encoder/Decoder" or Endec is a device which implements the FC-1 layer 
protocol. 

A "Router" is a module which determines the destination port from an address 

2 0 and other Fibre Channel frame parameters. 

A "Port Control" is a module which reads in a Fibre Channel header, requests 
a route and forwards the frame to the switch core. 

"Credit" is the login credit which represents the number of frames that may be 
transmitted before receiving an acknowledgement or R_RDY. 

2 5 "Fabric Login Protocol" is when an N_Port interchanges Service Parameters 

with the Fabric by explicitly performing the Fabric Login protocol or implicitly through 
an equivalent method not defined in FC-PH. 

"Application Specific Integrated Circuit" or (ASIC), an integrated circuit 
designed to perform a particular function by defining the interconnection of a set of 

3 0 basic circuit building blocks drawn from a library provided by the circuit manufacturer. 
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"FPGA" Field Programmable Gate Array, a gate array where the logic network 
can be programmed into the device after its manufacture. An FPGA consists of an array 
of logic elements, either gates or lookup table RAMs, flip-flops and programmable 
interconnect wiring. Most FPGAs are dynamically reprogrammable, since their logic 
5 functions and interconnect are defined by RAM cells. 

"FIFO" a data structure or hardware buffer from which items are taken out in 
the same order they were put in. 

"Bridge" a device which forwards traffic between network segments based on 
datalink layer information. These segments would have a common network layer 
1 0 address. 

"Router" a device which forwards traffic between networks. The forwarding 
decision is based on network layer information and routing tables, often constructed by 
routing protocols. 

"Brouter" a device which bridges some packets (i.e. forwards based on datalink 
15 layer information) and routes other packets (i.e. forwards based on network layer 
information). The bridge/route decision is based on configuration information. 
"Hub" a device connecting several other devices. 

"Serdes" serial encoder/decoder, converts the Fibre Channel serial interface 
to/from a 10 or 20 bit parallel interface. 

2 0 "HIPPI" is a computer bus for use over fairly short distances at speeds of 800 

and 1600 megabytes per second. HIPPI is described by the ANSI standard X3T9/88- 
127. 

"SCSI" or Small Computer System Interface is a standard for system-level 
interfacing between a computer and intelligent devices including hard disks, tape drives, 
25 andmanymore. SCSI is described by the ANSI standard X3. 13 1-1 986 and by ISO/TEC 
9316. 

"ATM" or Asynchronous Transfer Mode is a method for the dynamic allocation 
of bandwidth using a fixed-size packet, also called a cell. 

"SNMP" or Simple Network Management Protocol is an Internet Standard 

3 0 protocol defined in RFC 1157, developed to manage nodes on an IP network. 
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"MIB" or management information base is a database of managed objects 
accessed by network management protocols such as SNMP. 

"Web" is the World-Wide Web, an Internet client-server distributed information 
retrieval system which originated from the CERN High-Energy Physics Laboratories 
5 in Geneva, Switzerland. 

"Web Browser" is a program which allows a person to read information from 
the Web. The browser gives some means of viewing the contents of nodes (or "pages") 
and of navigating from one node to another. 

10 B. Fibre Channel Fabric Model 

Referring to Fig. 1, a Fibre Channel Fabric is an entity which transports Fibre 
Channel frames between attached devices. The data transmission between the 
connected device port (i.e., N_Port) and the Fabric port (i.e., F Port) is serial and 
consists of one or more frames. The transmission protocol and speeds along with the 

15 fabric functionality are defined in the American National Standard for Information 
Systems (ANSI) FCPH standard (see Other documents, section H, below). 

The primary function of the Fabric is to receive frames from a source N_Port 
and route the frames to the destination N_Port whose address identifier is specified in 
the frames. Each N_Port is physically attached through a link to the Fabric or in the 

2 0 case of an Arbitrated Loop topology attached to the same loop. FC-2 specifies the 
protocol between the Fabric and the attached N_Ports. A Fabric is characterized by a 
single address space in which every N_Port has a unique N_Port identifier. 

The Fabric model contains three or more F_Ports or FL_Ports. Each F_Port is 
attached to an NJPort through a link. Each F_Port is bidirectional and supports one or 

2 5 more communication models. The receiving F_Port responds to the sending N_Port 

according to the FC-2 protocol The Fabric optionally verifies the validity of the frame 
as it passes through the Fabric. The Fabric routes the frame to the F_Port directly 
attached to the destination N Port based on the N_Port identifier (D_JD) embedded in 
the frame. The address translation and the routing mechanisms within the Fabric are 

3 0 transparent to N_Ports. 
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There are two Sub-Fabric models, a Connection based model and a 
Connectionless based model. The Connection based Sub-Fabric provides Dedicated 
Connections between F_Ports and the N_Ports attached to these F_Ports. A Dedicated 
Connection is retained until a removal request is received from one of the 
5 communicating N_Ports or an exception condition occurs which causes the Fabric to 
remove the Connection. The Connection based Sub-Fabric is not involved in flow 
control which is managed end-to-end by the N_Ports. If the Fabric is unable to 
establish a Dedicated Connection, it returns a busy or reject frame with a reason code. 

A Connectionless Sub-Fabric is characterized by the absence of Dedicated 
1 0 Connections. The Connectionless Sub-Fabric multiplexes frames at frame boundaries 
between an F_Port and any other F_Port and between the NJPorts attached to them. 

A given frame flows through the Connectionless Sub-Fabric for the duration of 
the routing. After the frame is routed, the Connectionless Sub-Fabric is not required to 
have memory of source, routing or destination of the frame. When frames from 
15 multiple N_Ports are targeted for the same destination NJPort in Class 2 or Class 3, 
congestion of frames may occur within the Fabric. Management of this congestion is 
part of the Connectionless Sub-Fabric and buffer-to-buffer flow control. 

FIG. 1 shows a possible environment containing a Fibre Channel fabric. The 
fabric 1, 2 illustrated are connected with a mix of workstations 3, disk arrays 4, 
2 0 mainframe computers 5, and Personal Computers (PC) 6. Fabric interconnection is not 
limited to particular equipment or a network topology as illustrated in FIG. 1. Two 
types of fabric topologies are illustrated in FIG. 1., the direct fabric attached topology 
9 and the arbitrated loop topology 7. 

The fabrics in FIG. 1 are shown interconnected or networked through a link 8. 

2 5 All links to the fabric can operate at either 266 Mbps, 533Mbps or 1 .063 Gbps speeds 

and operate over either copper or fiber media, or any other compatible media.. 

FIG. 2 shows a block diagram of the fabric. The fabric is composed of a fabric 
control module 54, a router module 52, multiple port control modules 51, 74, 75 a 
switch core module 53 and optionally one or more brouter modules 55. As is 

3 0 understood in the art, the functions allocated to these respective devices may, in 

alternate embodiments, be allocated to different logical blocks. 
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The fabric control module 54 contains a processor and associated hardware. 
The fabric control module software performs but is not limited to the following 
functions: (1) Fabric power on self test, (2) Fabric configuration, (3) Broadcast, Simple 
Name, ARP and Directory services servers, (4) Fabric Loop Attached profile Extended 
5 link service command, (5) Management, (6) Network Management SNMP agent, (7) 
Web based fabric management, (8) Uninterruptable power supply monitoring and 
control, and (9) Brouter Module Configuration/Control. The Fabric Control module 
controls and configures the rest of the fabric but is not usually involved in the normal 
routing of frames. 

1 o The fabric Router 52 performs some or all of the following functions: (1) route 

address matching, (2) route determination based on the ANSI X3T1 1 rules, (3) route 
request blocking and unblocking, (4) switch core programming 63, (5) statistics 
collection and (6) port control module route request/response handling 59, 60, 61, 62, 
66, 67, 72, 73. 

1 5 The fabric Port Control modules (PCM) 5 1, 70, 74, 75 perform some or all of 

the following functions: (1) receive Fibre Channel frames from the fiber or copper 
media 56, 77, 78, (2) perform frame validation, (3) send a route request to the router 59, 
61, 66, 72, (4) receives a route response from the router 60, 62, 63, 67, 73, (4) forwards 
the frame to the switch core 57, 69, and (5) either discards the frame, modifies the frame 

2 0 into a fabric reject (F RJT) or fabric busy (F BSY) frame or forwards the frame 

depending on the route response from the router. 

The fabric switch core 53 is a nonblocking NxN matrix switch with 36 bit wide 
transmit and receive I/Os. The switch core switches frames from the PCMs 5 1, 70, 74, 
75 to the destination PCMs or Brouter Module. 

2 5 The Brouter Module 55 performs some or all of the following functions: 

protocol bridging and/or routing function between a Fibre Channel network and the 
network implemented by the Brouter Module. The Brouter Module "looks" like a Fibre 
Channel port to the rest of the switch. This is due to a protocol conversion function in 
the Brouter Module which converts the brouter networked frames to Fibre Channel 

3 0 frames. Converted Fibre Channel frames from the Brouter Module enter the fabric 
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switch through an internal port control module 70. Fibre Channel frames from the fabric 
switch core enter the Brouter Module through an internal path 76. 

C. Fabric Control Module 

FIG. 2 shows the Fabric Control module (FCM) 54. The FCM 54 serves some 
or all of the following funtions: configures the fabric, collects and reports network 
management parameters and implements the fabric defined servers such as the Simple 
Name Server, Directory Services, etc. The FCM 54 configures the router 52, the port 
control modules 51, 74, 75 and the brouter module 55. 

FIG. 3 shows the Fabric Control module (FCM) in more detail. The FCM is 
made up preferably of fast SRAM 82, DRAM 83, a DUART 84, flash memory 85 
(nonvolatile storage), a processor 81 and a Decode/DMA Control module 87. The code 
for the processor is contained in the flash memory 85 and is copied to SRAM upon 
bootup. The interface to the brouter module 55 allows the FCM to communicate 
through legacy networks such as ethernet and fast ethernet, depending on the brouter 
module. 

The FCM is attached to the rest of the fabric in two different manners: both in- 
band 80 to the fabric and out of band 79 to the fabric. The in-band connection is 
through the internal port control module. This connection allows the Fabric Control 
Module to communicate with both locally and remotely attached Fibre Channel 
compliant devices via Fibre Channel frames. The FCM connects out of band to the rest 
of the system for monitoring, initialization and control reasons. 

D. Fabric Router 

The Fabric Router 52 (FIG. 2) receives route requests generated from the Port 
Control modules 59, 61, 66, 72, determines the frame route, reports the route responses 
to the Port Control modules 60, 62, 67, 73, programs the switch core to connect and 
disconnect the routes 63, manages blocked route requests and collects the routing 
statistics. In the preferred embodiment, there is one central router contained in a fabric. 
The Router 52 connects and disconnects routes on a frame by frame basis. Since the 
router can determine a route in real time (i.e., Fibre Channel frame time) the Fabric can 
support Class 1 frames. The router is realized in hardware through either an FPGA or 
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a custom ASIC. The router is composed of thirteen functional modules as illustrated 
in FIG. 4: 

( 1 ) Port Control Route Request Interface (PCRRTM) 1 3 0 

(2) Port Control Route Response Interface (PCRSPM) 144 

(3) Address Table 132 

(4) Address Match Module (ADM) 1 3 1 

(5) Blocked Route Request Table Module (BRTBL) 1 3 3 

(6) Blocked Route Request Port Register Array (BRRA) 1 34 

(7) Blocked Route Request Timer (BRTMR) 135 

(8) Route Request Unblock Determination Module (RRUNB) 1 36 

(9) Route Request Selector (RRS) 137 

(10) Route Determination Module (RDM) 138 

(11) Route State Table (RST) 1 39 

(12) Router Statistics Gathering Module (RST) 141 

(13) Router Control FSM (RCFSM) 140. 



1. Port Control Route Request Interface Module (PCRRTM) 
The Port Control Route Request Interface Module (PCRRTM) 130 of FIG. 4 
(and FIG. 24 numeral 581) interfaces with the PCMs (5 1, 74, 75 of FIG. 2) to read route 
2 0 requests and registers the route request for use by the internal router modules. The 
PCRRTM FIG. 24 is composed of the following functional blocks: round-robin 
arbitration 582, route request state machine 583, registered route request 584, and the 
port winning arbitration register 585. The PCRRTM 581 is connected to each PCM 
(items 56, 77 and 78 of FIG. 4) through a separate PCM requester signal 586. The 

2 5 PCRRTM 58 1 is also connected to each PCM through a common shared route request 

data channel 588. After a PCM captures an incoming frame and builds a route request 
the PCM raises the PCM route request signal 586. The PCRRTM round robin 
arbitration block 582 will read all request signals and choose the requester in a round 
robin manner. This implements requester fairness, i.e., one requester will not be able 

3 0 to starve other concurrent PCM requesters. The round robin arbitration block 582 will 

notify the winning PCM requester via the route request state machine 583 by pulsing 
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for one clock period the PCM acknowledge signal 587 back to the winning PCM. 

During the next four clocks the PCM sends the route request over the common route 

request channel 588 to the registered route request block 584. The Route Request 

channel is implemented as an eight bit bus, but is not restricted to that size. The route 

request is thirty two bits and is shown in FIG. 31. The signals are described below. 

Route Request Description 
Field 

SID Mismatch Indicates that the mcoming frame SID does not match the 
expected SID 

EOFrcvd Indicates that the entire frame including the EOF was 

received 

Route Direct A flag to override the router address matching logic. This 

is used to route frames from the fabric control module out 
to a specific port without the use of the DID field 

Delimiter Is an encoded field which specifies the received frames 

delimiter 

Destination The DID from the incoming frame. This field is valid 

Address only when the route direct flag is not set. 

Destination port Only valid when the route direct flag is set, indicates the 
to route to remote port to route the frame to. 



The winning PCM port number is registered 585 (FIG. 24) and held for use by 
the internal router modules 589. The PCRRIM is controlled by the Router Control 
FSM through the request serviced signal 591 . The PCRRIM will raise the request valid 
signal 590 whenever it has a valid route request from a PCM in its register 584. The 
PCRRIM will halt any further route request reads from the PCM until the request 
serviced signal 591 is pulsed for one clock period by the Router Control FSM. 

FIG. 26 shows the PCRRIM state machine. The state machine is described 

below. 

State Description 



IDLE 611 

CMP_RR_VECT 612 



SHIRTRRVECT 613 
WAITCLK614 



LDWORD0, 1,2,3 
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Wait for a route request from a port control 
Route robin logic, compare the current select 
vector with the port control. If a match occurs 
the port control is currently requesting a route. 
Shift the current select vector. 
Signal the select port control module, wait one 
clock before reading the route request channel 
for the route request. 

Read the route request from the route request 
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RTNAVAIL 619 



615,616,617,618 



channel. Since the route request channel is 8 
bits wide and the route request is thirty two 
bits, four clocks are needed to read the route 
request. 

Wait until the Main Route Control FSM 
signals that the route request is no longer 
needed (RTACK) then return to idle and wait 
for another route request from the port control 
modules. 




yl 

S 15 
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2. Port Control Route Response Interface Module (PCRSPM) 

As shown in FIG. 4 the Port Control Route Response Interface Module 
(PCRSPM) 144 interfaces with all the PCMs 1 14, the Route Determination module 138 
and the Router Control FSM module 140. The PCRSPM main function is to return 
route responses to the PCMs 1 14. The PCRSPM 144 is independent of the PCRRIM 
101 which enables the router 52 to concurrently receive route requests and send route 
responses. This separation in function adds parallelism to the router, permits pipelined 
operation of the router and increases its performance. 

As shown in FIG. 25 the PCRSPM is preferably composed of the following 
functional blocks: the route response state machine 602 and the route response register 
603. The PCRSPM registers the route response 608 from the Route Detennination 
module when the load route response signal 607 is pulsed for one clock period by the 
Router Control FSM 140 (FIG. 4). When the Router Control FSM 140 pulses the send 
route response signal 606 the route response state machine 602 will inform the PCM 
corresponding to the port vector 609 by pulsing the PCM response acknowledgement 
signal 604 and putting the route response on the common route response channel 605 
for the next four clocks. FIG. 32 shows the thirty two bit route response format. An 
eight bit common route response channel is shown but a thirty two bit wide channel can 
be used depending on the implementation. 

FIG. 27 shows the PCRSPM state machine (item 602 of FIG. 25). The state 
machine is described below. 



State 



Description 



IDLE 631 



Wait for main Router Control FSM to assert the return 
route response signal. 
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XMTRSP 632 Acknowledge the main Router Control FSM that the 

route response will be returned. Signal the specific port 
control module the route response will be on the route 
response data channel on the next two clocks. 

XMT_DT0 633 Load the first eight bits of the route response on the 
route response data channel. 

XMT DTl 634 Load the second eight bits of the route response on the 
route response data channel, return to IDLE. 

3. Address Table 

The Address Table 132 of FIG. 4 is initially configured by the processor in the 
fabric control module 122. The Address Table 132 contains entries against which the 
5 incoming Fibre Channel frame destination identifier (DJD) is compared. FIG. 33 
shows the preferred address table entry format. The address entry contains a twenty 
four bit address mask register along with a twenty four bit address register. The 
incoming DJD is ANDed with the address mask register and the result is compared to 
the address register. This allows a match to be performed on any number of bits in the 

1 0 address. This also implements routing based on any combination of the address domain 
(upper eight bits of the address field), area (middle eight bits of the address field) or port 
(lower eight bits of the address field) fields. Additional address fields include the 
destination port and the address priority fields. The destination port indicates which 
remote F_Port to route the frame to and the address priority field specifies a priority for 

15 this address table entry match. For any two address matches the address table entry 
match which is the highest priority will be used. This implements an alternate routing 
in case of port failure. 

4. Address Match Module (ADM) 

2 0 The Address Match module 13 (ADM) in FIG. 4 (FIG. 13 numeral 351) 

performs the comparison with the mcoming frame DID address from the route request 
105 with the Address Table contents 109. The results are used by the Route 
determination module 138. As shown in FIG. 13 the ADM 351 has as an input the 
twenty-four bit address to match 352, i.e., the incoming frame DJD address from the 

25 route request, and returns the following responses: the remote match port 354, the 
address matched indication 355 and the route to control module indication 353. The 
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ADM will match an incoming D_ID address to all the addresses in the address table in 
one clock. The ADM logic is implemented in combinatorial logic. The ADM performs 
the following checks for each address table entry: 

Address Match indication = (address in table = (address mask & D_ED)) 
5 The results are then priority decoded based on address priority contained in the 

address table and the resulting address match signal and port are generated. There is 
one special mode which is implemented which will preemptively route all frames to the 
Fabric Control module except frames originating from the Fabric Control module. This 
allows the fabric control module to process all incoming frames which is useful when 
1 0 the fabric is functioning in certain environments. 

5. Blocked Route Request Table (BRTBU 

The Blocked Route Request Table 133 (BRTBL) in FIG. 4 functions to save 
blocked route requests. Preferably, it is realized by an array of registers. The BRTBL 

1 5 saves enough information to regenerate the route request once the blocking condition 
is cleared. The format of the blocked route request is shown in FIG. 30. The blocked 
route request contains the requesting PCM port, the matched destination PCM port, the 
block reason, whether an EOF delimiter was received by the requesting PCM, i.e., 
whether the entire frame was received before the PCM requested a route, the delimiter 

2 0 in the incoming frame, i.e., SOF type, whether there was an address match, whether to 
route to the fabric control port and whether a fabric reject (F RJT) or fabric busy 
(F_BSY) should be generated. 

As shown in FIG. 4 the BRTBL reads the blocked route request from route 
request bus 107 when instructed to do so by the Route Control FSM 140. As shown in 

2 5 FIG. 1 7 a blocked route request is loaded upon a LOADFIFO 447 signal pulse by the 

Router Control FSM. Blocked route requests are cleared when the CLRFIFO 448 
signal is pulsed by the Router Control FSM. The port input vector, 449, selects which 
port location in the table to load or clear the blocked route request. There is one 
blocked route request entry for each PCM and the blocked route request is registered 

3 0 so certain fields are available FIG. 4 numeral 1 16 to the Route Request Unblock 

Determination module FIG. 4 numeral 136. As shown in FIG. 17, the BRTBL 441 
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contains the registered blocked route request table 442 so certain fields in the blocked 
route request can be monitored by other router internal modules, 443, 444, 445, 446. 
The signals which are monitored include whether the specific entry contains a blocked 
route request 444, the block reason 443 which includes blocked due to the remote port 
5 busy or blocked due to the remote port in a class 1 connection with a port other than this 
one, and intermix is not support by the remote port. Other monitored fields include 
whether the blocked request frame is a Class 1 frame as indicated by the SOF delimiter. 

6. Blocked Route Request Port Register Array (BRRA1 
1 0 The Blocked Route Request Port Register Array 1 34 (BRRA) in FIG. 4 reads 

in the requesting port 103 and saves it into a register array which keeps the PCM 
request order. This order is wired 1 18 to the Route Request Unblock Determination 
module 136. The BRRA is shown in more detail in FIG. 19. When the LOADFIFO 
483 signal from the Router Control FSM is pulsed for one clock period the requesting 
1 5 PCM port 482 is saved into position 0 numeral 489 of the register array. Register array 
entries are removed by the Route Request Unblock Determination module through the 
CLRFIFO 488 signal and DEQRQ_SEL 485 vector, i.e., when the CLRFIFO signal is 
pulsed for one clock period the BRRA will unload the register specified by the 
DEQRQ_SEL vector. 

20 Position 0 numeral 489 contains the newest route request and position 16 

numeral 490 contains the oldest route request. Register array contents are shifted by 
one, from the newest position to the oldest, when the LOADFIFO signal is pulsed to 
make room for the newest blocked route request port number. The shifting circuit must 
take into account 'holes' in the register array. The algorithm identifies the first free 

2 5 register array entry closest to position 0 and shifts all the entries from position 0 to the 

free register array entry. The shifting circuit creates a shift vector (STTMP) which is 
used to load the contents of the individual register array entries. The circuit is shown 
below in verilog for eight ports. 

always @(F1_NULL or F2_NULL or F3_NULL or F4_NULL or F5_NULL or 

3 0 F6_NULL or F7NULL or F8_NULL) begin 

// build fifo shift control word (indicates how to shift fifo) 
casex ({F8_NULL, F7_NULL, F6_NULL, F5_NULL, 
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F4_NULL, F3_NULL, F2_NULL, F1_NULL}) 



10 



5 



8'blxxxxxxx: STTMP = 8'bl 111111] 
8'b01xxxxxx: STTMP = 81)01 1 1 1 1 1 1 
8*b001xxxxx: STTMP = 8*b001 11111 
8'b0001xxxx: STTMP = 81)0001 1111 
8'bOOOOlxxx: STTMP = 81)00001 1 1 1 
8'bOOOOOlxx: STTMP = 81)00000111 
8'bOOOOOOlx: STTMP = 81)00000011 
8'b00000001: STTMP = 81)00000001 
default: STTMP = 81)00000000; 



endcase 



end // always 



15 



where F1_NULL, .... , F8_NULL are true if register array position 1 to 8 
(respectively) are empty. 



The shifting vector is then used with the CLRFIFO signal 484 and the dequeue 
port signal (DEQRQ_SEL) 485 to clear the register array contents, 
always @(posedge elk or negedge reset) begin 



7. Blocked Route Request Timer fBRTMPO 

The Blocked Route Request Timer 135 (BRTMR) in FIG. 4 implements one 
timer per PCM. The timer is enabled when a route request is blocked for the particular 

3 0 PCM. The timer is disabled when the blocked route request becomes unblocked. The 
BRTMR is controlled by the Route Control FSM which not only enables the timer but 
also indicates which timer to enable. Enabled timers are selected by the port from the 
incoming route request 104. Disabled timers are selected by the port from the route 
request selector module 146. The different timers are defined by the ANSI FCPH 

3 5 standard. When a timeout occurs the Route Request Unblock Determination module 
is signaled 1 19 to dequeue the blocked request as soon as possible. 



20 



25 




end 



8. 



Route Request Unblock Determination Module (RRUNB) 
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The Route Request Unblock Determination module 136 (RRUNB) in FIG. 4 
determines when and which blocked route request to unblock. The RRUNB reads 
information from the Blocked Route Request Table 116, the Blocked Route Request 
Port Register Array 118 the Blocked Route Request Timer 119 and the Route State 
5 Table 1 24. A more detailed view of the RRUNB is shown in FIG. 1 4, FIG. 1 5 and FIG. 
16. 

As shown in FIG. 14 the RRUNB 361 reads information from several internal 
router modules and determines the most recent and highest priority blocked route 
request to dequeue from the Blocked Route Request Table. The RRUNB signals the 

1 0 port to dequeue 371 to both the Blocked Route Request Table and the Router Control 
FSM. The inputs to the RRUNB include the following information from the Route 
State Table: Port is currently busy signal 365 and the Port is currently in a class 1 
connection signal 366. The inputs to the RRUNB from the Blocked Route Request 
Table include the blocked route request indication, the destination port in which the 

1 5 blocked route request is waiting for, the block reason (whether waiting for the remote 
port to become free or both free and disconnected from a Class 1 route), and if the 
blocked route request is a Class 1 frame. 

FIG. 16 shows part of the RRUNB circuit which generates intermediate terms 
necessary to calculate which blocked route requests to unblock. Each blocked route is 

2 0 waiting for certain conditions to clear from a destination port. The destination port 
vector 429, 431, 433, 435 is used to select which remote signal to look at 421, 422, 423, 
424, to generate the remote status 430, 432, 434, 436. For example if a route request 
is blocked from port 1 the destination port which port 1 is waiting for is used to select 
the remote port busy signal. It is also used to select the "remote port is currently in a 

2 5 Class 1 connection signal". 

FIG. 15 shows another part of the RRUNB circuit. There are seventeen 
different DEQxFLAGS, only two are shown for brevity, i.e., DEQOFLAG 381 and 
DEQ16 FLAG 382. The DEQx FLAG signals are generated according to the 
following circuit: 

3 0 DEQO FLAG = Timeout indication for port 0 from RTMR | [ 

((! (remote port 0 busy) && 
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(! (block reason = wait for remote port 0 Class 1 connected && (remote 
port 0 Class 1 connected)))) 
The timeout indication is generated from the BRTMR module 362 in FIG. 14. 
The remote port 0 busy 430 and the remote port 0 Class 1 connected signals 434 are 
5 generated from the circuit described in FIG. 16. The block reason comes from the 
BRTBL 369. There is one DEQOJFLAG signal for every PCM. 

As shown in FIG. 15 each DEQ_FLAG 381, 382 signal is input into sixteen 
multiplexers 383, 384, representing the number of potentially blocked route requests. 
Multiplexer numeral 383 uses the port number in the BRRA register array in position 
10 0, numeral 385, and multiplexer 384 uses the port number in the BRRA register array 
in position 16 numeral 386. For example if the contents of position 0 in the BRRA 
register array is port 4 then the DEQ4FLAG is select by multiplexer 383 and output 
5 to the DEQINDO signal 387. The DEQIND signals 387, 388 are used as inputs to the 

Yfi binary encoder block 389. The binary encoder block 389 takes the highest DEQIND 

O 15 signal, DEQ1 6IND being higher than DEQOIND and encodes the value to a select 390 
irj which selects the position in the BRRA 392, 393 to dequeue 394. For example if 

^ 1 DEQ 1 6IND signal is set then the port number contained in position 1 6 of the BRRA is 

q output 394 from multiplexor 391 . 

J\ FIG. 15 also describes a similar circuit which accounts for blocked route 

$t 20 requests for Class 1 frames. The resulting port derived from this circuit takes 
■£> precedence to the circuit previously described. This allows priority dequeueing of 

blocked route requests for Class 1 frames. The circuit uses the DEQxFLAGs 387, 3 88 
generated from multiplexors identified by numeral 383 and 384. The DEQx FLAGs are 
ANDed with the remote port Class 1 connected signals generated in FIG. 16 numerals 

2 5 434, 436 to form the inputs 396, 397 to the multiplexors identified by numeral 398 and 

399. The multiplexors 398, 399 select the destination port contained in the BRRA array 
400, 401 . The output signals 402, 403 are binary encoded 404 to take the highest input 
signal to select the position in the BRRA 406, 407 to dequeue 408. 

The inputs to multiplexor numeral 395 represent the oldest blocked route 

3 0 request 394 and the oldest blocked route request of a Class 1 frame 408. Multiplexor 

395 will give priority to the Class 1 frame port 408 before choosing the oldest non- 
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Class 1 route request 394. The resulting vector 409 is the blocked route request to 
dequeue. 

This circuit can be used to unblock other types of resources besides Fibre 
Channel route requests. The circuit is implemented as combinatorial logic and selects 
5 the blocked route request within one clock. 

9. Route Request Selector AIRS') 

The Route Request Selector module 137 (RRS) in FIG. 4 functions to select 
between the incoming route request from the PCRRJM module 108 or the BRTBL 1 1 5. 
1 0 The resulting route request is output 1 1 0 to the Route Determination module. The RRS 
is controlled by the Route Control FSM 140. 

10. Route Determination Module fRDIVD 

The Route Determination module 138 (RDM) in FIG. 4 applies rules defined 
15 in the ANSI Fibre Channel specifications to calculate how to route the incoming frame. 
The RDM receives the route request 110 from the RRS 137 along with route context 
for the source and destination ports 112 from the Route State Table 139. The RRS 
outputs the route results 145, 111 to both the Router Control FSM 140 and the 
PCRSPM 144. The RDM is implemented in combinatorial logic and applied the route 
2 0 rules in one clock. 

FIG. 20 shows the RDM 501 in more detail. The RDM reads the route request 
from the RRS which includes the source requesting port 503, the destination port 504, 
the frame SOF delimiter 505, the EOF received flag 506, the route to port 0 (i.e., fabric 
controller) flag 507 and the timeout indication 508. The RDM also reads in the route 

2 5 table context for both the source and destination ports 512 and reads in a test enable 

vector 513. The test enable vector 513 turns off selected route rule checks for more 
flexibility when the router is implemented in an ASIC. The outputs from the RDM 
include the route results vector 509, 510 which indicates whether to route the frame or 
return an error, the reject/busy action/reason vector 10 which is valid when the RDM 

3 0 detects an error and the route back indication 511 which signals the port that the frame 

is in error and will routed back to the same port. Finally the updated source and 



OC-7042 .1 



27 

destination port contexts are updated to reflect the RDM actions 514 and wired back to 

the route state table 502. 

FIG. 21 shows the RDM route selection logic in more detail. As mentioned 

earlier the inputs to the RDM include the route state context for both the source and 

5 destination ports 522 and the route request 523. The RDM has prewired rules checks 

to detect five conditions: discard frame 525, block the route request until the remote 

port is not busy 526, return a fabric reject (F_RJT) frame 527, return a fabric busy 

(F_BSY) frame 528, wait until the frame is completely received 529. If all of the four 

conditions are not detected then the frame should be routed successfully to the remote 

1 0 port The conditions mentioned above are derived from the ORing of multiple rules 

checks. For example the discard frame signal is derived from the ORing of five discard 

frame rules checks. An example rules check is shown below. 

// discard frame if local SOFcl received and local port is in a class 1 connection 
wire DISFRM4 = TEN[2] && DELIM = SOFnl && SRC_CSTATE = 

15 Connected; 

The TEN[2] term above selects a bit from the test enable vector. Turning the 
bit off will disable the above rules check. The rule above will assert the DISFRM4 
signal if the incoming frame contains an SOFnl delimiter and the incoming port is not 
already in a Class 1 connection. 

2 0 As shown in FIG. 21 all potential rules check results 531 are encoded and 

selected by using the rules checks 525, 526, 527, 528, 529 as the multiplexor selector. 
The routing result selected is then output 532 to both the Router Control FSM and the 
PCRSPM. All rules checks are completed within one clock period. 

Finally FIG. 22 shows how the preencoded fabric reject 544 and fabric busy 

2 5 responses 548 are selected by the fabric reject 542 and fabric busy 546 rules checks. 

The result 551 is output to the PCRSPM module to be included in the route response. 
11. Route State Table (RST^l 

FIG. 4 shows the Route State Table (RST) 139. The function of the RST is to 
keep the current context for each port. The RST interfaces with the Route 

3 0 Determination Module (RDM) 1 38, the Route Request Unblock Determination Module 

(RRUNB) 136 and the processor in the Fabric Control module 121. FIG. 20 shows the 
RST 502 in relation to the RDM 501. The RST is controlled by the Router Control 
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FSM which signals the RST 515 to either output the source and destination context 512 
or save the updated source and destination context 514. The RST outputs certain 
context fields into the RRUNB FIG. 4 numeral 124 to assist in route request unblocking 
calculation. 

The RST contains a context entry for each port. The context entry is shown in 

FIG. 34. There are two parts to the route context: a static portion which is updated by 

the processor in the Fabric Control module FIG. 2 numeral 54 and a dynamic portion 

updated by the RDM module FIG. 4 numeral 138. The processor updates the static 

portion upon infrequent events such as power up and fabric login. The RDM updates 

the dynamic portion on a per frame basis. In current commercially available fabrics a 

processor manages all of the route state table fields, the current embodiment uses a 

register memory in the RST and the RDM to update the context. The table below lists 

the context fields. 

Signal Description 
Destination Port If a route exists this specifies the remote port. 

Connected To 

Class 1 Destination If this port is in a Class 1 connection this field 

Port specifies the remote port. 

Timer State If this port is waiting for a route and a timer is 

enabled, this field specifies the timer. 
Class 1 Connection This field specifies whether this port is currently 
State in a Class 1 connection. 

Port Busy This field specifies whether this port is currently 

routing a frame to a remote port. 
Port State This field specifies the link state, whether 

initializing, offline, online, or error. 
Class Supported This field specifies the Classes of service 

supported by this port. 
Loop Port Indication This field specifies whether this port is a loop 

port or a point to point port. 
Port Speed This field specifies the link speed for this port. 

Intermix Support This flag specifies support for Intermix for this 

port. 

FLOGI occured This field specifies whether a FLOGI/ACC 

exchange occurred. 



12. Router Statistics Gathering Module fRSG) 

FIG 4. shows the Router Statistics Gathering Module (RSG) 141. The RSG 
gathers fabric generated statistics. The RSG is enabled by the Router Control FSM 140 
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and has as inputs the source and destination ports, the route result and the frame Class 
142. The RSG is implemented in hardware because of the requirement of collecting 
statistics at gigabit rates. 

5 13. Router Control FSM (RCFSIW 

FIG. 4 shows the Router Control FSM (RCFSM) 140. The RCFSM controls the 
entire router through control signals to the internal router modules 147. The RCFSM 
state diagram is shown in FIG. 18. 

The RCFSM is triggered from idle by one of three events: a processor request 
10 to read or write a router data structure 470, a blocked route request becoming unblocked 
471 or an incoming route request received from a port control module signal 472. The 
three events are prioritized in case of multiple simultaneous events. The priorities from 
high to low include: 1) processor request, 2) a blocked route request becoming 
unblocked and 3) an incoming route request. When a processor updates any of the 
1 5 router fields the router must be in a quiescent state, i.e., not updating any data structure. 
When a processor requests access to a router data structure the processor signals the 
RCFSM by asserting the BLKCTLREQ signal. If in idle the RCFSM enters the 
RTBLKED state 452 and waits until the processor has finished its access. While in the 
RTBLKED state the RCFSM signals it is in this state by asserting the BLKCTLACK 
2 0 signal. The router processor interface logic will hold off the processor access via a 
WAIT signal until the BLKCTLACK signal is enabled. 

The remaining RCFSM diagram states and description is discussed below. 
Refer to FIG. 18 for the state diagram and to FIG. 4 for the module description. 
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State 
DEQROUTE 467 

CLR FEFO 468 

DECODERRSP 455 

RTOK 456 

RTBSY 459 

RTRJT 460 

RTDISCARD 461 
RTWAIT_EOF 462 
RTBLK 463 

PGMSW 457 
RTNRSP 458 
LDRTSTATE 464 

LD RT 453 
SOFOREOF 454 



Description 

Program RRS 137 to use the newly unblocked 

route request as an input 115 

Signal the BRTBL 133 to remove the blocked 

route 

Wait one clock for the RDM 138 to apply routing 
rules checks to the route request 110 
The RDM 138 has determined the route is ok. 
Signal the RST 139 to update the route table, 
signal the RSG 141 to collect statistics for this 
route and select the destination port from the 
ADM 131 results. 

The RDM 138 has determined to return a fabric 
busy (F_BSY) frame to the sending port. Signal 
the RST 139 to update the route table, signal the 
RSG 141 to collect statistics and assign the 
destination port from the source port (i.e., route 
F_BSY back to the same port). 
The RDM 138 has determined to return a fabric 
reject (FRJT) frame to the sending port. Signal 
the RST 139 to update the route table, signal the 
RSG 141 to collect statistics and assign the 
destination port form the source port (i.e., route 
F RJT back to the same port). 
The RDM 138 has determined that the port 
control module should discard the frame. Signal 
the RSG 141 to collect statistics. 
The RDM 1 38 has determined that the port 
control module should wait until the entire frame 
is received before resubmitting the route request. 
The RDM 138 has determined to block the route 
request. The BRTBL 133 and the BRRA 134 are 
signaled to save the route request and save the 
port requesting the route. 

Program the switch core 123 to make a path from 

the source to the destination port. 

Signal the PCRRSPM 144 to return a route 

request complete indication. 

Signal the RST 139 to update its context and 

signal the BRTMR 104 to enable a blocked route 

request timer. 

Signal the RRS 137 to read the route request 108 
that was just read from the PCRRIM 130. 
Signal the PCRRIM 130 to fetch another route 
request since the current request is registered in 
the RRS 137 module. Load the route results from 
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the RDM 138 into the PCRRSPM 144 (in case 
delimiter is an EOF). Go to the DECODERRSP 
455 state if the delimiter in the route request is an 
SOF otherwise go to the EOFDELIM 465 state. 

EOFDELIM 465 Signal the RRS 1 37 to use the destination port 

from the route context in the RST 139. 

DISTIMER 466 Signal the switch core to disconnect the path from 

the specified source port to the destination port, 
signal the RST 139 to update the route table 
context to reflect the disconnected path and signal 
the PCRRSPM 144 to return a route request 
complete indication. 

E. Port Control 

FIG. 2 shows the Port Control (PC) locations 51, 70, 74, 75, within the fabric 
block diagram. Preferably, there is one PC per port or link. The PC interfaces with the 
fabric attached device through either copper or fiber media 56, 77, 78. The PC 
5 interfaces to the switch core through transmit 58 and receive 57 data buses and control 
signals. The PC interfaces to the router through route request 59, 61, 66, 72 and route 
response 60, 62, 67, 73 buses and control signals. Finally the PC interfaces to the 
Fabric Control module through a processor interface bus 65. 

FIG. 5 shows the Port Control in more detail. Frames are received from the 

1 0 fiber or copper link 151 and enter the Endec 1 53. The Endec implements the 8B/10B 
encoding/decoding, the loop port state machine and fabric/point-to-point state machine 
functions and outputs thirty two bit data words with two bits of parity and tag 
information to the receive FIFO 155. The PC contains a module which guards against 
a receive FIFO overrun 154 condition. Once the receive FIFO 155 starts filling, the 

15 Port Control Module (PCM) 156 reads the frame header, requests a route from the 
router 163, 164 and forwards the frame to the switch core 161, 162. The PCM is 
configurable by the processor 170 in the Fabric Control module. The Port Control also 
receives frames from the switch core 165, 166 to be transmitted by the Endec 153. 
Port Control Module CPCM) 

2 0 FIG. 10 shows the Port Control Module (PCM) in more detail. The PCM is 

responsible for reading a portion of the received header from the input FIFO 250, 
building a route request for the router 262, 263, 264, 260, receiving the route response 
from the router 265, 266, 261 and either forwarding the frame to the switch core 249 
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or building a fabric reject (F_RJT) or fabric busy (F_BSY) frame and forwarding those 
to the switch core. The PCM also performs miscellaneous functions such as receive 
frame validation against parity errors, short frames, frames too large, tag errors and 
other checks. 

5 The PCM is composed of the following four modules: 

(1 ) Port Control FIFO Module (PCFIFO) 247 

(2) Port Control to Router I/F Module (PCRTIF) 234 

(3) Port Control Main Control FSM (PCFSM) 232 

(4) Port Control Configuration/Counter Module (PCCFG) 233 

10 

1. Port Control FIFO module rPCFEFCT) 

FIG. 10 shows the Port Control FIFO module (PCFIFO) 247. The PCFIFO 
buffers several words of the incoming frame with internal registers. The registers 
include four general input registers (fifo_reg0 237, fifo regl 238, fifo_reg2 239, 

1 5 fifo_reg3 240), five special input registers (sofreg 241, rctldid_reg 242, type_reg 243, 
param_reg 244, eofreg 245) and a main input and output register (EDATA_OUTR 236 
and SW DATAIN 246). The input register (EDATAOUTR) gates the data in from 
the input FIFO 250 by asserting the FIFOREQ_ signal. The output register sends the 
data to the switch core by asserting the SWACK_ signal 249. The general and special 

2 0 input registers are loaded from the EDATA OUTR register. The general and special 
registers also are connected to a multiplexor which feeds the SW_DATAIN register 
246. The special registers allow the PCFIFO to build fabric reject (F_RJT) and fabric 
busy (F_BSY) frames and to insert special EOF delimiters when the route response 261 
specifies to do so. 

2 5 The received destination address (D ID) along with the SOF delimiter is wired 

to the PCRTIF module 254 to build the route request 260. Finally the PCFIFO is 
controlled by the PCFSM 232. 

The PCFIFO module performs certain frame validations. These validations 
include parity and tag field checking and regeneration, CRC, invalid transmit word and 

3 0 link down while receiving frame validations. When the frame validations fail the 
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PCFIFO automatically inserts the appropriate EOF delimiter 251, either an EOF a, 
EOFni or EOFdti. 

The PCFIFO will build a fabric frame reject (FRJT) when the route response 
from the router specifies to do so 261 . The PCFIFO builds the fabric reject by changing 
5 certain fields in the frame header 241 , 242, 244. Since the entire header is not yet in the 
PCFIFO internal registers a counter is implemented to indicate when to insert the 
modified header fields. The frame fields which are modified include the R_CTL field 
242, the parameter field 244 and potentially the EOF delimiter 245. In addition if there 
was a payload associated with the frame it is discarded. 
10 The PCFIFO will also build a fabric busy (F BSY) frame when the route 

response from the router response specifies to do so 261. The PCFIFO modifies the 
RCTL field 242, the type field 243 and potentially the EOF delimiter 245. As in the 
F RJT frame modification the payload for the F_BSY frame is discarded. 



15 2. Port Control Main Control Module flPCFSM) 

FIG. 10 shows the Port Control Main Control Module (PCFSM) module 232 

(PCM). The PCFSM controls the other modules which compose the PCM 252, 258, 

272. The PCFSM is triggered by a frame being received from the input FIFO. FIG. 1 1 

shows the PCFSM state diagram and is described in detail below. 

State Description 
IDLE 301 Wait until the first three words of a frame are received 

from the input FIFO. This is the first state after a 
system reset. 

CLRSOF 302 A frame has been received. Reset the EOF register and 

start the route request signal if the frame is not a short 
frame. 

ROUTEFRM 303 In this state the PCFSM signals the PCRTEF to send a 
route request (RREQ) to the router. The PCFSM will 
loop in this state until a route response (RRACK) is 
received back from the router. 

XMTFRM 304 Transmit the frame through the Port Control from the 
input receive FIFO to the switch core. 

RTNRJTBSY 308 The router has determined that a fabric reject (F RJT) 
or fabric busy (F_BSY) frame should be returned. The 
SOF delimiter is modified along with the R CTL field. 

WAITEOF 306 Wait until an EOF is received. The Port Control 

usually implements cut through routing, i.e., when a 
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UPDATECDT 
306 



WAITEOF1 309 



XMTFRJTBSY 
10 



frame is received it is forwarded to the remote before 
the end of frame is received. Certain conditions dictate 
that the frame should be received in its entirety before 
being forwarded. An example condition includes the 
remote port speed is lower than the source port. 
Signal the PCRTIF to send a route disconnect request 
(RREQ) and loop in this state until a route 
disconnected response (RRACK) signal is received. 
This one clock state is entered into after transmitting or 
discarding a frame. If a Class 2 or Class 3 frame was 
operated on the Endec CREDIT_ signal is pulsed. The 
EOF register (RESETEOF) is cleared, the frame 
counter is cleared and the EOF in received FIFO 
counter is decremented. 

Wait until an EOF is received from the Endec due to a 
F_RJT/F_BSY frame being returned. An EOF must be 
received so as to not cause a transmitter underrun at the 
remote Endec. 

Wait until an EOF is transmitted which signals that the 
F RJT or F_BS Y EOF was transmitted. While in the 
XMT FRJTBSY state assert either the xmt_frjt or 
xmt_fbsy signal to the PCFIFO module to specify 
which frame to transmit. 



3. Port Control Configuration/Counter Module (TCCFG") 
FIG. 10 shows the Port Control Configuration/Counter (PCCFG) module 233. 
The PCCFG maintains counters and provides the processor interface 271 to the Port 
Control Module. The PCCFG contains an EOF received counter 267, a current frame 
count register 268 and a port control configuration register 269. The EOF received 
counter keeps track of the number of full frames received by the Endec contained in the 
receive frame FIFO. The current frame count register monitors the current number of 
words received on a per frame basis. This counter is used to detect short and long 
frames. Finally the port control configuration register contains miscellaneous 
information/configuration information used by the Port Control module. 
The port control configuration register fields are described below. 

Field Bit Location Description 

Max Frame Size 9:0 



LISM Mode 



10 



Indicates the maximum receive 
frame size in words. 
The Port is currently going through 
loop initialization indication 
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Clear Interrupt 


11 


Clear the bad parity notification 






interrupt. 


Pulse CDT_ line 


12 


Pulse the Endec credit line. 


Clear Interrupt 


13 


Clear interrupt latch 


Enable Remote 


14 


Enable preemptive remote port 


Port Routing 




routing. 


This Port Number 


19:16 




EOF Counter 


26:24 


Counter value for the number of EOF 






delimiters received from the Endec. 


Frame Discarded 


27 


Frame was discarded by the Port 






Control. 


Frame Too Short 


28 


A frame which was less than eight 


Detected 




words in length was received. 


Frame Too Big 


29 


A frame which was greater than the 


Received 




specified maximum frame size (bits 9 






to 0) was received. 


Tag Error 


30 


A tag error was detected (i.e., a tag 


occurred 




ofeitherOOor 11). 


Parity Error 


31 


Clear parity interrupt indication 


occurred 




register. 



4. Port Control to Router Interface Module (TCRTIR 
FIG. 10 shows the Port Control to Router Interface Module (PCRTIF) 234. The 
PCRTIF builds route requests for the router 260, signals the router that a valid request 
5 is present 262, waits for a router response valid signal (RTPCREQ) 263 and receives 
the router response 261. The PCRTIF builds the route request from the D ID field, the 
SOF delimiter and some miscellaneous signals from both the PCFIFO 254 and the 
PCCFG 273 modules. The route request is transmitted over a shared command channel 
bus 264 to the router. This command channel bus is shared by all the PCMs. The route 
1 0 response is received over a different shared response channel bus (RT_DATA) 266 
which is also shared by all the PCMs. By implementing different buses or channels for 
the route request and route response the router can simulataneously read route requests 
along with returning route responses. 

15 FIFO Overrun Prevention Logic fFOPL) 

FIG. 5 shows the FIFO Overrun Prevention Logic (FOPL) 154 within the Port 
Control area. The purpose of the FOPL is to handle the case where the FIFO 1 55 is full 
and frames are received by the Endec 153. Since the frame arrival rate is extremely fast 
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at gigabit link data rates, the FOPL must act in real time. An additional situation the 
FOPL must handle is when the frame arrives and is being routed to the remote port and 
the back end of the frame overruns the FIFO. Still another situation is where multiple 
frames overrun the FIFO. The FOPL operates on the TAG bits 154 not the data bits 
5 171. The Endec takes gigabit serial transmission from the link side, decodes the 
transmission and outputs thirty two bit words to the port control FIFO. Along with the 
thirty two bit words are a two bit tag field and a two bit parity field. The tag and parity 
field additions are a common interface characteristics. Tag bits are bits attached to the 
thirty two bit words to indicated delimiters such as the SOF or EOF. When the FIFO 

10 is full and a frame is received from the Endec the FOPL sets the tag bits to an illegal 
value. When the FIFO enters the not full condition the next word will contain the 
illegal tag bits. The illegal tag bits will signal the Port Control modue to abort the 
frame with the appropriate EOF delimiter. 

FIG. 8 shows the FOPL in more detail. The FOPL 201 interfaces with the 

15 Endec tag bits 202, the Endec receive frame DMA request signal 203, and the Endec 
receive frame DMA acknowledgement 204 signal. The FOPL interfaces with the FIFO 
by supplying the tag bits and through the FIFONOTEMPTY 206 signal. During normal 
operation the FOPL will set the FIFO tag bits 205 to the value of the Endec tag bits 202. 
When the FIFO is full, i.e., when the FIFONOTEMPTY signal 206 is deasserted, the 

20 FOPL will output an illegal value for the tag bits 205 going to the FIFO. If the 
overflow word is the last word to be received the FOPL will wait until the 
FIFONOTEMPTY signal 206 is asserted and then output a word with bad tag bits by 
asserting the FIFO WRITE 207 signal. This last scenario handles the case where the last 
word received overflows the FIFO and there are no other words to receive. 

25 

Processor/Data Arbitration Logic (PDAD 

FIG. 5 shows the Processor/Data Arbitration Logic (PDAL) 157 within the Port 
Control area. Since the Endec 153 multiplexes the transmit bus with the internal 
register configuration bus, logic is needed to arbitrate between processor accesses 168 
30 and frames being transmitted from the switch core 166. This logic must manage 
processor accesses to the Endec which are slower than transmit data word dma's. In 
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other words if a frame is currently being transmitted, processor accesses to the Endec 
must be held off until either the frame transmission is complete or the internal Endec 
transmit FIFO is full, allowing enough time for a processor access before a transmitter 
underrun occurs. 

5 The PDAL acts as the arbitrator between processor accesses and transmit data 

to the Endec. The PDAL accomplishes this by keeping track of when the switch core 
is transmitting frames to the Endec and inserting processor accesses between frames or 
when the Endec 's internal transmit FIFO is full. FIG. 9 shows the PDAL in more 
detail. The PDAL interfaces to the Endec through the Endec transmit frame DMA 

1 0 request 209 signal, the chip select 208 and the wait 207 signals. The PDAL interfaces 
with the switch core through the transmit frame dma request signal 212. The PDAL 
interfaces with a bus transceiver 225 through an enable signal 216. The PDAL 
interfaces with the processor from the Fabric Control module through the chip select 
214, wait 215 and write 222 signals. Finally the PDAL interfaces to the Router Module 

15 through the route busy 226 signal. The processor will only access the Endec 
transmit/configuration bus 224 when the wait signal 215 is deasserted. The PDAL uses 
two conditions to create the processor wait signal. The first condition is that there are 
no frames being transmitted to the Endec. This condition is indicated by the route busy 
signal 226 from the router being deasserted. The second condition is the transmit frame 

2 0 dma request signal 209 deasserted, indicating that the internal Endec transmit FIFO is 
full. The second condition creates enough time for a processor access to the Endec 
internal registers before the Endec' s internal transmit FIFO empties. 
Port Control Hub Module 

FIG. 29 shows the Port Control Hub Module (PCHM). The PCHM extends the 

2 5 functionality of the Port Control Module by adding several Fibre Channel Arbitrated 

Loop Hub ports. This has the affect of leveraging a single switch port over multiple 
attached devices 705. All attached devices 705 are logically on a single loop connected 
to the switch through an internal Endec 700. The internal Endec is connected on the 
loop by both a transmit 701 and receive 702 serdes modules. The output of the serdes 

3 0 module is a gigabit serial stream of data. The loop is repeated by commercially 

available 1.0625 Gbit/sec Channel Repeater/Hub Circuits 703 such as Vitesses' 
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VSC7120. (See, e.g., Vitesse Semiconductor Corporation "1996 Communications 
Products Data Book")- The repeater/hub circuits contain a monolithic Clock Recovery 
Unit (CRU), a digital Signal Detect Unit (SDU) and a Port Bypass Circuit (PBC). The 
repeater/hub circuits allow devices to attach and detach without interrupting the loop. 
5 The repeater/hub circuits are connected to a Gigabit Interface Converter (GBIC) 
module 704 which supports either copper or fiber media via a plug in module. All 
repeater/hub circuits are controlled by the fabric control processor through a register 
705. This allows the fabric control module to monitor the state of each port and 
integrate the status with the general switch network management. 
10 The integral hub provides many advantages over standalone hubs. These 

advantages include: 

Leveraging the redundant power supplies and fans usually resident in 

the fabric 

Segmenting loops to allow for increased performance per loop and 
1 5 greater immunity from loop failure 

Allowing for hot pluggable hub boards 

Leveraging the switches SNMP network management capability for 
greater control and monitoring of the loop. 

20 F. Switch Core 

FIG. 2 and 6 shows the Switch Core. The switch core implements a 
nonblocking NxN matrix switch. The input to the switch core comes from the 
individual Port Control modules FIG. 2 numerals 57, 69 and FIG. 9 183, 186. The 
output from the switch core is wired to the Endec FIG. 2 numeral 58, FIG. 9 numeral 

2 5 220 and the Brouter Module FIG. 2 numeral 76. The switch core is paths are setup and 

torn down by the router FIG. 2 numeral 63. 

G. Brouter Module 

FIG. 2 numeral 55 and FIG. 7 show the Brouter Module. The Brouter Module 

3 0 receives frames from the switch core 76 and transmits frames to the internal Port 

Control module 70. The Brouter Module is responsible for converting Fibre Channel 
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frames to frames of the connected network 68. The Brouter Module looks to the rest 
of the fabric like a Port Control module. The Brouter module sends and receives frames 
which adhere to the Fibre Channel protocol. The frames are converted within the 
Brouter module to other network frames such as Ethernet, Fast Ethernet, or Gigabit 
5 Ethernet and are transmitted out to the network connection 68. 

Although the foregoing invention has been described in some detail by way of 
illustration and example for purposes of clarity and understanding, it may be readily 
apparent to those of ordinary skill in the art in light of the teachings of this invention 
that certain changes and modifications may be made thereto without departing from the 
1 0 spirit or scope of the appended claims. 

H. Other Documents 

ANSI X3.230-1994, "Fibre Channel Physical and Signaling Interface (FC-PH)". 
ANSI X3.297-1996, "Fibre Channel Physical and Signaling Interface (FC-PH- 

15 2)". 

ANSI X3.303-1996, "Fibre Channel Physical and Signaling Interface (FC-PH- 

3)". 

ANSI X3.272-1996, "Fibre Channel Arbitrated Loop (FC-AL)". 
ANSI X3T1 1 Project # 1133-D, "Fibre Channel Arbitrated Loop 2 (FC-AL2)". 
2 0 ANSI X3T1 1/95-41, "Fibre Channel Fabric Generic Requirements (FC-FG), 

Rev 3.2" 

ANSI X3T11 Project 1134-D "(FC-GS2)". 

ANSI X3T1 1 Project 959-D "Fibre Channel Switch Topology (FC-SW)". 
ANSI X3T1 1 Project 1235-DT, "Fibre Channel Fabric Loop Attachment (FC- 
2 5 FLA) Rev 2.2" 

FCA "NPort to F_Port Interoperability Profile, Rev 1.0" 
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I Claim: 

1. A fibre channel switching fabric for connecting multiple attached 
devices comprising: 

multiple port control modules, the port control modules being adapted 
5 for communication with the attached devices, the port control module 

functioning to build a route request and read a route response, 

a router module, the router module being connected to the port control 
modules by a route request connection and by a separate route response 
connection, and 

10 a switch core, the switch core being connected to the port control 

modules. 

2. The fibre channel switching fabric of claim 1 for connecting multiple 
attached devices further including a fabric control module connected to the router 

1 5 module and port control modules. 

3. The fibre channel switching fabric of claim 1 for connecting multiple 
attached devices wherein there is one port control module for each attached device. 

2 0 4. The fibre channel switching fabric of claim 1 for connecting multiple 

attached devices wherein at least one port control module is attached to a arbitrated loop 
having multiple attached devices. 

5. The fibre channel switching fabric of claim 1 for connecting multiple 
2 5 attached devices wherein the port control module further serves to modify frames. 

6. The fibre channel switching fabric of claim 1 for connecting multiple 
attached devices wherein the port control module modifies frames to fabric frame busy 
(FJ8SY). 

30 
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7. The fibre channel switching fabric of claim 1 for connecting multiple 
attached devices wherein the port control module modifies frames to fabric frame reject 
(F_RJT). 

5 8. The fibre channel switching fabric of claim 1 wherein the port control 

module further functions to discard frames. 

9. The fibre channel switching fabric of claim 1 for connecting multiple 
attached devices wherein the port control module performs frame validation. 

10 

10. The fibre channel switching fabric of claim 9 for connecting multiple 
attached devices wherein the frame validation includes parity error validation. 

1 1 . The fibre channel switching fabric of claim 9 for connecting multiple 
1 5 attached devices wherein the frame validation includes invalid transmit word correction. 

12. The fibre channel switching fabric of claim 9 for connecting multiple 
attached devices wherein the frame validation detects frame size error. 

2 0 13. The fibre channel switching fabric of claim 9 for connecting multiple 

attached devices wherein the port control module further performs frame connection. 

14. The fibre channel switching fabric of claim 1 for connecting multiple 
attached devices wherein the fabric is connected in a direct fabric attached topology. 

25 

15. The fibre channel switching fabric of claim 1 for connecting multiple 
attached devices wherein the fabric is connected in an arbitrated loop attached topology. 

16. The fibre channel switching fabric of claim 1 for connecting multiple 

3 0 attached devices wherein the attached devices include fibre channel compliant devices 



OC-7042.1 



selected from the group comprising: 
a storage device and a disk array. 
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a mainframe, a workstation, a personal computer, 



17. The fibre channel switching fabric of claim 1 for connecting multiple 
5 attached devices wherein the attached devices include a second fabric. 

18. The fibre channel switching fabric of claim 1 for connecting multiple 
attached devices wherein the switch core comprises a full crossbar. 

10 19. The fibre channel switching fabric of claim 1 for connecting multiple 

attached devices further including a bridge module. 

20. The fibre channel switching fabric of claim 1 for connecting multiple 
attached devices further including a hub module. 

15 

21. The fibre channel switching fabric of claim 1 for connecting multiple 
attached devices wherein the attached devices are connected to the fabric by a serial 
link. 

2 0 22. The fibre channel switching fabric of claim 2 1 for connecting multiple 

attached devices wherein the link is a copper connection. 

23. The fibre channel switching fabric of claim 21 for connecting multiple 
attached devices wherein the link is a fiber optic connection. 

25 

24. The fibre channel switching fabric of claim 1 for connecting multiple 
attached devices wherein the fabric receives fibre channel frames of at least one 
gigahertz. 

3 0 25. The fibre channel switching fabric of claim 1 for connecting multiple 

attached devices which supports Class 1 service. 
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26. The fibre channel switching fabric of claim 1 for connecting multiple 
attached devices which supports Class 2 service. 

5 27. The fibre channel switching fabric of claim 1 for connecting multiple 

attached devices which supports Class 3 service. 

28. The fibre channel switching fabric of claim 1 for connecting multiple 
attached devices which supports each of Class 1, Class 2 and Class 3 service. 

10 

29. The fibre channel switching fabric of claim 28 for connecting multiple 
attached devices which further supports intermix service. 

30. A method for servicing route requests from multiple attached devices 
15 where the routing is subject to blocked and unblocked conditions, the method 

comprising the steps of: 

servicing a route request which is not blocked, and 
saving a blocked route request in hardware and servicing that request if 
the route changes from a blocked to an unblocked condition prior to the 

2 0 expiration of a specified time period. 

31. The method of claim 30 wherein the saved route request includes 
sufficient information to regenerate the route request once the blocked condition is 
cleared. 

25 

32. The method of claim 31 wherein the saved information regarding the 
blocked route request includes the requesting port control module port. 

33. The method of claim 31 wherein the saved information regarding the 

3 0 blocked route request includes a matched destination port control module port. 
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34. The method of claim 3 1 wherein the saved information regarding the 
blocked route request contains the blocking condition. 

35. The method of claim 31 wherein the saved information regarding the 
blocked route request includes the indication of an end of frame delimiter being 
received by the requesting port control module port. 

36. The method of claim 31 wherein the saved information regarding the 
blocked route request includes a delimiter in the incoming frame. 

37. The method of claim 31 wherein the saved information regarding the 
blocked route request includes whether there was an address match. 

38. The method of claim 31 wherein the saved information regarding the 
blocked route request includes whether to route to the fabric port control module. 

39. The method of claim 31 wherein the saved information regarding the 
blocked route request includes whether a fabric reject frame (FJRJT) is to be generated. 

40. The method of claim 31 wherein the saved information regarding the 
blocked route request includes whether a fabric busy frame (FJBSY) is to be generated. 

41. A fibre channel fabric for connecting multiple attached devices 
supporting connection based service and connectionless based service between attached 
devices, comprising: 

multiple port control modules, the port control module being adapted for 
connection to an attached device, 

a router, the router being in communication with the port control 
modules to receive route requests and to generate route responses and to provide 
the route responses to the port control modules, the port control modules being 
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connected to the router by separate route request connections and route response 
connections, and 

a single switch core for support of connection based service between 
attached devices and connectionless based service between attached devices. 

5 

42. The fibre channel fabric of claim 41 for connecting multiple attached 
devices further including a fabric control, the fabric control in communication with the 
port control modules. 

10 43. The fibre channel fabric for connecting multiple attached devices of 

claim 41 wherein the single switch core is a non-blocking switch core. 

44. The fibre channel fabric for connecting multiple attached devices of 
claim 41 wherein the dedicated connection is maintained in the switch core until a 

1 5 removal request is received. 

45. A fibre channel fabric for connecting multiple attached devices 
supporting connection based service and connectionless based service between attached 
devices, comprising: 

2 0 multiple port control modules, the port control module being adapted for 

connection to an attached device, 

a router, the router being in communication with the port control 
modules to receive route requests and to generate route responses and to provide 
the route responses to the port control modules, the router constructing a route 

2 5 in two microseconds or less, and 

a single switch core for support of connection bases service between 
attached devices and connectionless based service between attached devices. 

46. A fibre channel fabric for connecting multiple attached devices 

3 0 supporting connection based service and connectionless based service between attached 

devices, comprising: 
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multiple port control modules, the port control module being adapted for 
connection to an attached device, 

a router, the router being in communication with the port control 
modules to receive route requests and to generate route responses and to provide 
5 the route responses to the port control modules, the router including multiple 

state machines which result in pipelined operation for handling route requests 
and route responses, and 

a single switch core for support of connection bases service between 
attached devices and connectionless based service between attached devices. 

10 

47. A fibre channel switching fabric for connecting multiple attached 
devices comprising: 

multiple port control modules, the port control modules including a 
connection for communication with attached devices, a route request generator, 
1 5 and a route request response receiver, 

a router, the router including an input for receiving the output of the 
route request generator of the port control modules, an output for sending a 
route request response to the route request response receiver in the port control 
module, a hardware finite state machine to receive the route request, and a 
2 0 hardware finite state machine to provide the route response, the router further 

including a route determination system which determines a route within a single 
clock cycle of the system, and 

a switch for selective interconnect of the port control modules. 

25 48. The fibre channel switching fabric of claim 47 for connecting multiple 

attached devices wherein the router control includes a hardware finite state machine. 

49. The fibre channel switching fabric of claim 47 for connecting multiple 
attached devices wherein the single clock cycle is 30 nanoseconds or less. 

30 
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50. An improved port control module for use in a fibre channel switching 
fabric comprising: 

an input/output port for connection to a link, 

an encoder/decoder in communication with the input/output port, and 
5 a buffer, 

the improvement comprising the inclusion of buffer overrun prevention 
logic between the encoder/decoder and the buffer. 

5 1 . The improved port control module for use in a fibre channel switching 
1 0 fabric of claim 50 wherein the buffer is a first-in, first-out buffer. 

52. The improved port control module for use in a fibre channel switching 
fabric of claim 50 where the buffer overrun prevention logic sets tag bits to a unique 
valve indicative of an overrun conditions. 

15 

53. A method for control of an input buffer, where the input buffer is 
adapted to receive a stream of data at a rate which is not subject to control by the buffer, 
comprising the steps of: 

receiving the data, 
2 0 placing the data in the buffer, 

monitoring for an overflow condition, 

and if an overflow condition is detected, including a detectable signal in 
association with the data, and 

providing the data from the buffer and the detectable signal to 

2 5 subsequent devices. 

54. The method of claim 53 for control of an input buffer, the detectable 
condition comprising tag bits. 

3 0 55 . The method of claim 54 for control of an input buffer wherein the tag 

bits are set to a unique condition. 
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56. A fibre channel switching fabric for connecting multiple attached 
devices, comprising: 

multiple port control modules, the modules being adapted for 
5 communication over links to the attached devices, 

a router connected to the port control modules, the router including: 
a port control route request state machine, 
a port control route response state machine, and 
a route determination module, 
10 the port control route request state machine, the route 

determination module and the port control route response state machine 
connected in a serial manner for pipeline operation, and 
a switch connected to the port control modules and the router. 

1 5 57. The fibre channel switching fabric of claim 56 for connecting multiple 

attached devices further including a fabric control system connected to the port control 
modules and router. 

58. The fibre channel switching fabric of claim 56 for connecting multiple 

2 0 attached devices further including a router control state machine. 

59. The fibre channel switching fabric of claim 56 for connecting multiple 
attached devices wherein the port control route request state machine includes a round- 
robin arbitration selection unit which is connected to the port control modules. 

25 

60. The fibre channel switching fabric of claim 59 for connecting multiple 
attached devices wherein each port control module is separately connected to the round- 
robin arbitration selection unit. 

3 0 61. The fibre channel switching fabric of claim 60 for connecting multiple 

attached devices wherein the port control modules are connected to the port control 
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route request state machine by a shared route request data channel and separate route 
request connections. 

62. The fibre channel switching fabric of claim 61 for connecting multiple 
5 attached devices wherein the selection unit and the route request state machine provide 
a signal to the port control module which has been selected. 



63. A communication system for connecting multiple attached devices 
comprising: 

1 0 multiple port control modules, 

a router connected to the port control modules, 

a switch core connected to the router and the port control modules, the 
router providing selective interconnection between the port control modules, 
and 

15 an arbitrated loop adapted to connect to multiple attached devices, the 

arbitrated loop being connected to a port control module. 

64. A method for handling blocked route requests in a communications 
system, where a route request includes at least a destination address, a source address 

2 0 and priority information, comprising the steps of: 
receiving the route request, 
determining if the route can be completed, 
if the route cannot be completed, storing the route request, 
determining when to effectuate the route indicated by the route request 

2 5 and based upon the priority and state information, and 

completing the route when indicated by the time condition and the 
priority condition. 



65. The method for handling blocked route requests in a communication 
3 0 system of claim 64 wherein the priority information is from the group comprising: 
Class 1, Class 2 and Class 3 service. 
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Abstract 

The Fibre Channel standard was created by the American National Standard for 
information Systems (ANSI) X3T11 task group to define a serial I/O channel for 
interconnecting a number of heterogeneous peripheral devices to computer systems as 
5 well as interconnecting the computer systems themselves through optical fiber and 
copper media at gigabit speeds (i.e., one billion bits per second). Multiple protocols 
such as SCSI (Small Computer Serial Interface), IP (Internet Protocol), HIPPI, ATM 
(Asynchronous Transfer Mode) among others can concurrently utilize the same media 
when mapped over Fibre Channel. A Fibre Channel Fabric is an entity which transmits 
1 0 Fibre Channel frames between connected Node Ports. The Fibre Channel fabric routes 
the frames based on the destination address as well as other information embedded in 
the Fibre Channel frame header. Node Ports are attached to the Fibre Channel Fabric 
through links. 
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county, if the application in this county is filed within twelve months from the earliest date on which such foreign application was filed; but no patent shall be granted on any application 
for a patent for an invention which has been patented or described in a printed publication in any country more than one year before the date of the actual filing of the application 
in this country, or which had been in public use or on sale in this country more than one year prior to such filing. 

35 U.S.C. 120: BENEFIT OF EARLIER FILING DATE IN THE UNITED STATES 

An application for patent for an invention disclosed in the manner provided by the first paragraph of section 1 1 2 of this title in an application previously filed in the United 
States, or as provided by section 363 of this title, by the same invention shall have the same effect, as to such invention, as though filed on the date of the prior application, if filed 
before the patenting or abandonment of or termination of proceedings on the first application or on an application similarly entitled to the benefit of the filing date of the first application 
and if it contains or is amended to contain a specific reference to the earlier filed application. 

35U.S.C. 112: SPECIFICATION 



art to which it pertains, or with whic 
sntor of carrying out his invention. 

The specification shall conclude with one or more claims particularly pointing out and distinctive claiming the subject m 



I further declare that ail statements made herein of my own knowledge are true and that all statements made 
with the knowledge that willful false statements and the like so made are punishable by fine or imprisonment, 
or both, under section 1001 of Title 18 of United States Code, and that such willful false statements may 
jeopardize the validity of the application or any patent issuing thereon. 

SIGNATURE(S) 

Full name of sole or first inventor STUART B. BERMAN 

Inventor's signature — d^&tts i^sf' ^ 

Date "?/ I q 1 Country of Citizenship U.S.A. 

Residence 2010 Vista Caudal. Newport Beach. California 92660 



Post Office Address Same as Residence 



POWER OF ATTORNEY 



Docket 223/279 
Patent 



Arcxel Technologies. Inc. . assignee(s) of the application for United States Letters Patent for 

Fibre Cha nnel Switching Fabric 

(Tide) 

by Stuart B. Berman 

(Inventors) 

executed on even date herewith, or 

X having Serial No. 08/801.471 . filed February 18. 1997 . 

a copy of the assignment of which is attached hereto, do(es) hereby appoint as attorneys of record with full power of 
substitution and revocation, to prosecute this application and transact all business in the Patent and Trademark Office 
connected therewith: 



The registered attorneys listed below and members of or associates in the law firm of LYON & LYON, 63 j West Fifth Street, Suite 
4700, Los Angeles, California 90071, Registration No. 11,611, whose members are all admitted to the Bar of the State of California: 



Roland N. Stnoot 


Reg 


No. 18,718 


Conrad R. Solum, Jr. 


Reg 


No. 20,467 


James W. Geriak 


Reg 


No. 20,233 




Reg 


No. 19,848 


Samuel B. Stone 


Reg 


No. 19,297 


Douglas E. Olson 


Reg 


No. 22,798 


Robert E. Lyon 


Reg 


No. 24,171 


James 1. Short 


Reg 


No. 25.922 


RobettiC. Weiss 


Reg 


No. 24,939 


Ricr|5 E. Lyon, Jr. 


Reg 


No. 26,300 


John ft, McConaghy 


Reg 


No. 26,773 


WilfiM C. Steffin 


Reg 


No. 26,811 


CoeJA.IBloomberg 


Reg 


No. 26,605 



J. Donald McCarthy 

James H. Shalek 
Allan W. Jansen 
Robert W Dtckerson 
Roy L. Anderson 
David B. Murphy 
James C. Brooks 
Jeffrey M. Olson 
Steven D. Hemminger 
Jerrold B. Reilly 
John A. Rafter 
Kenneth H. Ohriner 



25,119 
27,483 
29,749 



30,790 
30,755 
32,293 



Mary S. Consalvi 
Lois M. Kwasigroch 
Lawrence R. LaPorte 
Robert C. Laurenson 
Carol A. Schneider 
Hope E. Melville 
Richard J. Warburg 
Michael J. Wise 
KurtT. Mulville 



32,212 
35,579 
38,948 
34,206 
34,923 
34,874 
32,327 
34,047 
37,194 
35,833 
37,625 
37,861 
38,283 
39,675 



Address correspondence to: LYON & LYON 
:j! Attention: David B. Murphy 

r 633 West Fifth Street, Suite 4700 

p Los Angeles, California 90071-2066 

5 (213) 489-1600 

M= I, the undersigned, declare that I am the (an) assignee of the above-identified application or, if the assignee is a 
corporation, partnership or other association, I am authorized to make this appointment on behalf of the assignee. The 
abiH-identified assignee is the owner of this application by reason of an assignment being filed herewith for recordation 
in the Patent Office on. In accordance with 37 CFR § 3.373(b), I certify that I have reviewed all documents in the chain 
of title, and to the best of my knowledge, all right, title, and interest is in the above-identified assignee, and I further declare 
that all statements made herein of my own knowledge are true and that all statements made on information and belief are 
believed to be true; and further, that these statements were made with the knowledge that willful false statements and the 
like so made are punishable by fine or imprisonment, or both, under section 1001 of Title 18 of the United States Code, 
and that such willful false statements may jeopardize the validity of the application or any patent issuing thereon. 



Arcxel Technologies, Inc. 



Post Office 
Address 



2691 Richter Avenue, Suite 106, Irvine, California 92774" 
-J- 



;larantor # ^ / .j 



Attorney's Docket No. 223/279 



Applicant or Patentee: Stuart B. Berman . 

Serial or Patent No.: 08/801.471 

Filed or Issued: February 18, 1997 

For: FIBRE CHANNEL SWITCHING FABRIC 

VERIFIED STATEMENT (DECLARATION) CLAIMING SMALL ENTITY 
STATUS (37 CFR 1.9(f) AND 1.27(c)) - SMALL BUSINESS CONCERN 

I hereby declare that I am 

the owner of the small business concern identified below: 

an official of the small business concern empowered to act on behalf of the concern identified 
below: 

NAME OF CONCERN ARCXEL TECHN OLOGIES. INC. 

ADDRESS OF CONCERN 2691 Richter Avenue. Suite 106. Irvine. California 92714 



I hereby declare that the above identified small business concern qualifies as a small business concern as 
defined in 13 CFR 121.3-18, and reproduced in 37 CFR 1.9(d), for purposes of paying reduced fees under 
Section 41 (a) and (b) of Title 35, United States Code, in that the number of employees of the concern, 
including those of its affiliates, does not exceed 500 persons. For purposes of this statement, (1) the number 
of employees of the business concern is the average over the previous fiscal year of the concern of the 
persons employed on a full-time, part-time or temporary basis during each of the pay periods of the fiscal year, 
and (2) concerns are affiliates of each other when either, directly or indirectly, one concern controls or has the 
power to control the other, or a third-party or parties controls or has the power to control both. 

I hereby declare that rights under contract or law have been conveyed, to and remain with the small business 
concern identified above with regard to the invention, entitled 

Fibre Channel Switching Fabric 



by inventor(s) Stuart B. Berman 



described in 

the specification filed herewith 

_X the application serial no. 08/801.471 . filed February 18. 1997 
patent no. , issued . 

If the rights held by the above identified small business concern are not exclusive, each individual, concern or 
organization having rights to the invention is listed below* and no rights to the invention are held by any 
person, other than the inventor, who could not qualify as an independent inventor under 37 CFR 1.9(c) or by 
any concern which would not qualify as a small business concern under 37 CFR 1.9(d) or a nonprofit 
organization under 37 CFR 1 .9(e). 

*NOTE: Separate verified statements are required from each named person, concern or organization having rights to the invention 
averring to their status as small entities. (37 CFR 1.27). 



Attorney's Docket No. 223/279 



NAME 

ADDRESS 

Individual _ Small Business Concern _ Nonprofit Organization 

NAME 

ADDRESS 

Individual _ Small Business Concern Nonprofit Organization 

I acknowledge the duty to file, in this application or patent, notification of any change in status resulting in loss 
of entitlement to small entity status prior to paying, or at the time of paying, the earliest of the issue fee or any 
maintenance fee due after the date on which status as a small business entity is no longer appropriate. (37 
CFR 1.28(b)). 

I hereby declare that all statements made herein of my own knowledge are true and that all statements made 
on information and belief are believed to be true; and further that these statements were made with the 
knowledge that willful false statements and the like so made are punishable by fine or imprisonment, or both, 
under Section 1001 of Title 18 of the United States Code, and that such willful false statements may jeopardize 
the validity of the application, any patent issuing thereon, or any patent to which this verified statement is 
directed. 

NAME OF PERSON SIGNING S7f*&r & Sefi./»^J 

TITLE OF PERSON SIGNING CHttr -fccHW^ Y <?PE7 c le/L, 

ADDRESS OF PERSON SIGNING z^m \/ isrA c-^ucAL . 

/ie-At^H , <fA 

SIGNATURE ^2^^4^L— DATE 7//<f/?7 



2 



